2023-03-11 22:52:56,835 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.mob.compactions.TestMobCompactor timeout: 13 mins 2023-03-11 22:52:57,059 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/87368fcc-6f9d-8d4a-6393-acc3a85b6a4f 2023-03-11 22:52:57,072 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=1, rsPorts=, rsClass=null, numDataNodes=1, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-03-11 22:52:57,073 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/87368fcc-6f9d-8d4a-6393-acc3a85b6a4f/cluster_01183c7b-d60b-1c38-923f-d300051bd96f, deleteOnExit=true 2023-03-11 22:52:57,073 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-03-11 22:52:57,074 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/87368fcc-6f9d-8d4a-6393-acc3a85b6a4f/test.cache.data in system properties and HBase conf 2023-03-11 22:52:57,075 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/87368fcc-6f9d-8d4a-6393-acc3a85b6a4f/hadoop.tmp.dir in system properties and HBase conf 2023-03-11 22:52:57,075 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/87368fcc-6f9d-8d4a-6393-acc3a85b6a4f/hadoop.log.dir in system properties and HBase conf 2023-03-11 22:52:57,076 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/87368fcc-6f9d-8d4a-6393-acc3a85b6a4f/mapreduce.cluster.local.dir in system properties and HBase conf 2023-03-11 22:52:57,076 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/87368fcc-6f9d-8d4a-6393-acc3a85b6a4f/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-03-11 22:52:57,076 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-03-11 22:52:57,183 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-03-11 22:52:57,556 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-03-11 22:52:57,559 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/87368fcc-6f9d-8d4a-6393-acc3a85b6a4f/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-03-11 22:52:57,559 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/87368fcc-6f9d-8d4a-6393-acc3a85b6a4f/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-03-11 22:52:57,560 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/87368fcc-6f9d-8d4a-6393-acc3a85b6a4f/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-03-11 22:52:57,560 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/87368fcc-6f9d-8d4a-6393-acc3a85b6a4f/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-03-11 22:52:57,560 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/87368fcc-6f9d-8d4a-6393-acc3a85b6a4f/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-03-11 22:52:57,561 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/87368fcc-6f9d-8d4a-6393-acc3a85b6a4f/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-03-11 22:52:57,561 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/87368fcc-6f9d-8d4a-6393-acc3a85b6a4f/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-03-11 22:52:57,561 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/87368fcc-6f9d-8d4a-6393-acc3a85b6a4f/dfs.journalnode.edits.dir in system properties and HBase conf 2023-03-11 22:52:57,562 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/87368fcc-6f9d-8d4a-6393-acc3a85b6a4f/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-03-11 22:52:57,562 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/87368fcc-6f9d-8d4a-6393-acc3a85b6a4f/nfs.dump.dir in system properties and HBase conf 2023-03-11 22:52:57,563 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/87368fcc-6f9d-8d4a-6393-acc3a85b6a4f/java.io.tmpdir in system properties and HBase conf 2023-03-11 22:52:57,563 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/87368fcc-6f9d-8d4a-6393-acc3a85b6a4f/dfs.journalnode.edits.dir in system properties and HBase conf 2023-03-11 22:52:57,563 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/87368fcc-6f9d-8d4a-6393-acc3a85b6a4f/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-03-11 22:52:57,563 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/87368fcc-6f9d-8d4a-6393-acc3a85b6a4f/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-03-11 22:52:58,093 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-03-11 22:52:58,098 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-03-11 22:52:58,363 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-03-11 22:52:58,536 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-03-11 22:52:58,557 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-03-11 22:52:58,603 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-03-11 22:52:58,645 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/87368fcc-6f9d-8d4a-6393-acc3a85b6a4f/java.io.tmpdir/Jetty_localhost_localdomain_32851_hdfs____.fiml1t/webapp 2023-03-11 22:52:58,782 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:32851 2023-03-11 22:52:58,823 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-03-11 22:52:58,824 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-03-11 22:52:59,478 WARN [Listener at localhost.localdomain/38541] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-03-11 22:52:59,668 WARN [Listener at localhost.localdomain/38541] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-03-11 22:52:59,708 WARN [Listener at localhost.localdomain/38541] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-03-11 22:52:59,717 INFO [Listener at localhost.localdomain/38541] log.Slf4jLog(67): jetty-6.1.26 2023-03-11 22:52:59,728 INFO [Listener at localhost.localdomain/38541] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/87368fcc-6f9d-8d4a-6393-acc3a85b6a4f/java.io.tmpdir/Jetty_localhost_33365_datanode____.y7b03r/webapp 2023-03-11 22:52:59,854 INFO [Listener at localhost.localdomain/38541] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33365 2023-03-11 22:53:00,375 WARN [Listener at localhost.localdomain/41563] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-03-11 22:53:00,962 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x756b4dd3f552374b: Processing first storage report for DS-c49b0644-b2ba-4f16-9222-18ee83a20d8c from datanode d759cbe2-d04a-43b0-bc2a-2313ebea261f 2023-03-11 22:53:00,963 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x756b4dd3f552374b: from storage DS-c49b0644-b2ba-4f16-9222-18ee83a20d8c node DatanodeRegistration(127.0.0.1:37271, datanodeUuid=d759cbe2-d04a-43b0-bc2a-2313ebea261f, infoPort=37883, infoSecurePort=0, ipcPort=41563, storageInfo=lv=-57;cid=testClusterID;nsid=1939390990;c=1678575178162), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-03-11 22:53:00,963 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x756b4dd3f552374b: Processing first storage report for DS-491e7526-fd3f-432f-918b-e605fc29a6c1 from datanode d759cbe2-d04a-43b0-bc2a-2313ebea261f 2023-03-11 22:53:00,964 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x756b4dd3f552374b: from storage DS-491e7526-fd3f-432f-918b-e605fc29a6c1 node DatanodeRegistration(127.0.0.1:37271, datanodeUuid=d759cbe2-d04a-43b0-bc2a-2313ebea261f, infoPort=37883, infoSecurePort=0, ipcPort=41563, storageInfo=lv=-57;cid=testClusterID;nsid=1939390990;c=1678575178162), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-03-11 22:53:01,049 DEBUG [Listener at localhost.localdomain/41563] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/87368fcc-6f9d-8d4a-6393-acc3a85b6a4f 2023-03-11 22:53:01,124 INFO [Listener at localhost.localdomain/41563] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/87368fcc-6f9d-8d4a-6393-acc3a85b6a4f/cluster_01183c7b-d60b-1c38-923f-d300051bd96f/zookeeper_0, clientPort=51815, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/87368fcc-6f9d-8d4a-6393-acc3a85b6a4f/cluster_01183c7b-d60b-1c38-923f-d300051bd96f/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/87368fcc-6f9d-8d4a-6393-acc3a85b6a4f/cluster_01183c7b-d60b-1c38-923f-d300051bd96f/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-03-11 22:53:01,135 INFO [Listener at localhost.localdomain/41563] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=51815 2023-03-11 22:53:01,145 INFO [Listener at localhost.localdomain/41563] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-03-11 22:53:01,148 INFO [Listener at localhost.localdomain/41563] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-03-11 22:53:01,822 INFO [Listener at localhost.localdomain/41563] util.FSUtils(471): Created version file at hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9 with version=8 2023-03-11 22:53:01,822 INFO [Listener at localhost.localdomain/41563] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/hbase-staging 2023-03-11 22:53:02,165 INFO [Listener at localhost.localdomain/41563] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-03-11 22:53:02,681 INFO [Listener at localhost.localdomain/41563] client.ConnectionUtils(127): master/jenkins-hbase20:0 server-side Connection retries=3 2023-03-11 22:53:02,711 INFO [Listener at localhost.localdomain/41563] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-03-11 22:53:02,711 INFO [Listener at localhost.localdomain/41563] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-03-11 22:53:02,712 INFO [Listener at localhost.localdomain/41563] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-03-11 22:53:02,712 INFO [Listener at localhost.localdomain/41563] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-03-11 22:53:02,712 INFO [Listener at localhost.localdomain/41563] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-03-11 22:53:02,840 INFO [Listener at localhost.localdomain/41563] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-03-11 22:53:02,920 DEBUG [Listener at localhost.localdomain/41563] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-03-11 22:53:03,002 INFO [Listener at localhost.localdomain/41563] ipc.NettyRpcServer(120): Bind to /148.251.75.209:44347 2023-03-11 22:53:03,011 INFO [Listener at localhost.localdomain/41563] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-03-11 22:53:03,013 INFO [Listener at localhost.localdomain/41563] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-03-11 22:53:03,031 INFO [Listener at localhost.localdomain/41563] zookeeper.RecoverableZooKeeper(93): Process identifier=master:44347 connecting to ZooKeeper ensemble=127.0.0.1:51815 2023-03-11 22:53:03,064 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:443470x0, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-03-11 22:53:03,066 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:44347-0x1000296b5630000 connected 2023-03-11 22:53:03,093 DEBUG [Listener at localhost.localdomain/41563] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-03-11 22:53:03,094 DEBUG [Listener at localhost.localdomain/41563] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-03-11 22:53:03,097 DEBUG [Listener at localhost.localdomain/41563] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-03-11 22:53:03,106 DEBUG [Listener at localhost.localdomain/41563] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44347 2023-03-11 22:53:03,107 DEBUG [Listener at localhost.localdomain/41563] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44347 2023-03-11 22:53:03,109 DEBUG [Listener at localhost.localdomain/41563] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44347 2023-03-11 22:53:03,114 DEBUG [Listener at localhost.localdomain/41563] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44347 2023-03-11 22:53:03,114 DEBUG [Listener at localhost.localdomain/41563] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44347 2023-03-11 22:53:03,120 INFO [Listener at localhost.localdomain/41563] master.HMaster(444): hbase.rootdir=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9, hbase.cluster.distributed=false 2023-03-11 22:53:03,186 INFO [Listener at localhost.localdomain/41563] client.ConnectionUtils(127): regionserver/jenkins-hbase20:0 server-side Connection retries=3 2023-03-11 22:53:03,186 INFO [Listener at localhost.localdomain/41563] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-03-11 22:53:03,186 INFO [Listener at localhost.localdomain/41563] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-03-11 22:53:03,186 INFO [Listener at localhost.localdomain/41563] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-03-11 22:53:03,186 INFO [Listener at localhost.localdomain/41563] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-03-11 22:53:03,187 INFO [Listener at localhost.localdomain/41563] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-03-11 22:53:03,191 INFO [Listener at localhost.localdomain/41563] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-03-11 22:53:03,194 INFO [Listener at localhost.localdomain/41563] ipc.NettyRpcServer(120): Bind to /148.251.75.209:41843 2023-03-11 22:53:03,197 INFO [Listener at localhost.localdomain/41563] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-03-11 22:53:03,202 DEBUG [Listener at localhost.localdomain/41563] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-03-11 22:53:03,203 INFO [Listener at localhost.localdomain/41563] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-03-11 22:53:03,206 INFO [Listener at localhost.localdomain/41563] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-03-11 22:53:03,208 INFO [Listener at localhost.localdomain/41563] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:41843 connecting to ZooKeeper ensemble=127.0.0.1:51815 2023-03-11 22:53:03,211 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:418430x0, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-03-11 22:53:03,212 DEBUG [Listener at localhost.localdomain/41563] zookeeper.ZKUtil(164): regionserver:418430x0, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-03-11 22:53:03,212 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:41843-0x1000296b5630001 connected 2023-03-11 22:53:03,213 DEBUG [Listener at localhost.localdomain/41563] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-03-11 22:53:03,214 DEBUG [Listener at localhost.localdomain/41563] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-03-11 22:53:03,218 DEBUG [Listener at localhost.localdomain/41563] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41843 2023-03-11 22:53:03,218 DEBUG [Listener at localhost.localdomain/41563] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41843 2023-03-11 22:53:03,219 DEBUG [Listener at localhost.localdomain/41563] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41843 2023-03-11 22:53:03,222 DEBUG [Listener at localhost.localdomain/41563] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41843 2023-03-11 22:53:03,222 DEBUG [Listener at localhost.localdomain/41563] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41843 2023-03-11 22:53:03,226 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase20.apache.org,44347,1678575181988 2023-03-11 22:53:03,235 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-03-11 22:53:03,236 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase20.apache.org,44347,1678575181988 2023-03-11 22:53:03,256 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-03-11 22:53:03,256 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-03-11 22:53:03,256 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-03-11 22:53:03,257 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-03-11 22:53:03,258 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase20.apache.org,44347,1678575181988 from backup master directory 2023-03-11 22:53:03,258 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-03-11 22:53:03,261 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase20.apache.org,44347,1678575181988 2023-03-11 22:53:03,261 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-03-11 22:53:03,261 WARN [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-03-11 22:53:03,261 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase20.apache.org,44347,1678575181988 2023-03-11 22:53:03,264 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-03-11 22:53:03,266 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-03-11 22:53:03,342 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/hbase.id with ID: 0b67ae53-1485-4735-a40b-c353dd600add 2023-03-11 22:53:03,415 INFO [master/jenkins-hbase20:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-03-11 22:53:03,431 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-03-11 22:53:03,515 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x7134dec7 to 127.0.0.1:51815 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-11 22:53:03,623 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1de4b7fc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-11 22:53:03,645 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-03-11 22:53:03,647 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-03-11 22:53:03,661 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-03-11 22:53:03,661 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-03-11 22:53:03,663 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-03-11 22:53:03,666 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-03-11 22:53:03,667 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-03-11 22:53:03,696 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/MasterData/data/master/store-tmp 2023-03-11 22:53:03,719 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-11 22:53:03,719 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-03-11 22:53:03,719 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-03-11 22:53:03,719 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-03-11 22:53:03,719 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-03-11 22:53:03,719 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-03-11 22:53:03,719 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-03-11 22:53:03,720 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-03-11 22:53:03,721 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/MasterData/WALs/jenkins-hbase20.apache.org,44347,1678575181988 2023-03-11 22:53:03,743 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C44347%2C1678575181988, suffix=, logDir=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/MasterData/WALs/jenkins-hbase20.apache.org,44347,1678575181988, archiveDir=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/MasterData/oldWALs, maxLogs=10 2023-03-11 22:53:03,802 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37271,DS-c49b0644-b2ba-4f16-9222-18ee83a20d8c,DISK] 2023-03-11 22:53:03,809 DEBUG [RS-EventLoopGroup-3-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-03-11 22:53:03,874 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/MasterData/WALs/jenkins-hbase20.apache.org,44347,1678575181988/jenkins-hbase20.apache.org%2C44347%2C1678575181988.1678575183752 2023-03-11 22:53:03,875 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37271,DS-c49b0644-b2ba-4f16-9222-18ee83a20d8c,DISK]] 2023-03-11 22:53:03,876 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-03-11 22:53:03,876 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-11 22:53:03,880 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-03-11 22:53:03,881 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-03-11 22:53:03,950 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-03-11 22:53:03,957 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-03-11 22:53:03,981 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-03-11 22:53:03,993 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-11 22:53:03,999 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-03-11 22:53:04,001 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-03-11 22:53:04,018 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-03-11 22:53:04,023 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-11 22:53:04,025 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67655248, jitterRate=0.008141756057739258}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-11 22:53:04,025 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-03-11 22:53:04,027 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-03-11 22:53:04,053 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-03-11 22:53:04,053 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-03-11 22:53:04,056 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-03-11 22:53:04,059 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-03-11 22:53:04,093 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 34 msec 2023-03-11 22:53:04,093 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-03-11 22:53:04,119 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-03-11 22:53:04,125 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-03-11 22:53:04,152 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-03-11 22:53:04,157 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-03-11 22:53:04,160 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-03-11 22:53:04,166 INFO [master/jenkins-hbase20:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-03-11 22:53:04,171 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-03-11 22:53:04,174 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-03-11 22:53:04,177 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-03-11 22:53:04,177 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-03-11 22:53:04,196 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-03-11 22:53:04,201 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-03-11 22:53:04,201 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-03-11 22:53:04,202 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-03-11 22:53:04,202 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase20.apache.org,44347,1678575181988, sessionid=0x1000296b5630000, setting cluster-up flag (Was=false) 2023-03-11 22:53:04,219 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-03-11 22:53:04,222 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-03-11 22:53:04,224 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,44347,1678575181988 2023-03-11 22:53:04,231 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-03-11 22:53:04,238 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-03-11 22:53:04,240 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,44347,1678575181988 2023-03-11 22:53:04,243 WARN [master/jenkins-hbase20:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/.hbase-snapshot/.tmp 2023-03-11 22:53:04,328 INFO [RS:0;jenkins-hbase20:41843] regionserver.HRegionServer(952): ClusterId : 0b67ae53-1485-4735-a40b-c353dd600add 2023-03-11 22:53:04,333 DEBUG [RS:0;jenkins-hbase20:41843] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-03-11 22:53:04,339 DEBUG [RS:0;jenkins-hbase20:41843] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-03-11 22:53:04,339 DEBUG [RS:0;jenkins-hbase20:41843] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-03-11 22:53:04,342 DEBUG [RS:0;jenkins-hbase20:41843] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-03-11 22:53:04,343 DEBUG [RS:0;jenkins-hbase20:41843] zookeeper.ReadOnlyZKClient(139): Connect 0x05755a37 to 127.0.0.1:51815 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-11 22:53:04,347 DEBUG [RS:0;jenkins-hbase20:41843] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@bb2b4e9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-11 22:53:04,348 DEBUG [RS:0;jenkins-hbase20:41843] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@f8d3147, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-03-11 22:53:04,374 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-03-11 22:53:04,376 DEBUG [RS:0;jenkins-hbase20:41843] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase20:41843 2023-03-11 22:53:04,381 INFO [RS:0;jenkins-hbase20:41843] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-03-11 22:53:04,381 INFO [RS:0;jenkins-hbase20:41843] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-03-11 22:53:04,381 DEBUG [RS:0;jenkins-hbase20:41843] regionserver.HRegionServer(1023): About to register with Master. 2023-03-11 22:53:04,383 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-03-11 22:53:04,383 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-03-11 22:53:04,383 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-03-11 22:53:04,383 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-03-11 22:53:04,383 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase20:0, corePoolSize=10, maxPoolSize=10 2023-03-11 22:53:04,383 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-03-11 22:53:04,383 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-03-11 22:53:04,384 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-03-11 22:53:04,384 INFO [RS:0;jenkins-hbase20:41843] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase20.apache.org,44347,1678575181988 with isa=jenkins-hbase20.apache.org/148.251.75.209:41843, startcode=1678575183185 2023-03-11 22:53:04,386 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1678575214386 2023-03-11 22:53:04,388 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-03-11 22:53:04,392 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-03-11 22:53:04,393 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-03-11 22:53:04,398 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-03-11 22:53:04,399 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-03-11 22:53:04,403 DEBUG [RS:0;jenkins-hbase20:41843] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-03-11 22:53:04,405 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-03-11 22:53:04,406 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-03-11 22:53:04,406 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-03-11 22:53:04,406 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-03-11 22:53:04,413 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-03-11 22:53:04,415 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-03-11 22:53:04,416 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-03-11 22:53:04,416 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-03-11 22:53:04,419 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-03-11 22:53:04,419 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-03-11 22:53:04,420 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1678575184420,5,FailOnTimeoutGroup] 2023-03-11 22:53:04,421 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1678575184420,5,FailOnTimeoutGroup] 2023-03-11 22:53:04,421 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-03-11 22:53:04,421 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-03-11 22:53:04,423 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-03-11 22:53:04,423 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-03-11 22:53:04,472 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:49759, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-03-11 22:53:04,489 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.ServerManager(394): Registering regionserver=jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:04,503 DEBUG [RS:0;jenkins-hbase20:41843] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9 2023-03-11 22:53:04,504 DEBUG [RS:0;jenkins-hbase20:41843] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost.localdomain:38541 2023-03-11 22:53:04,504 DEBUG [RS:0;jenkins-hbase20:41843] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-03-11 22:53:04,509 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-03-11 22:53:04,510 DEBUG [RS:0;jenkins-hbase20:41843] zookeeper.ZKUtil(162): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:04,510 WARN [RS:0;jenkins-hbase20:41843] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-03-11 22:53:04,510 INFO [RS:0;jenkins-hbase20:41843] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-03-11 22:53:04,511 DEBUG [RS:0;jenkins-hbase20:41843] regionserver.HRegionServer(1947): logDir=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/WALs/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:04,512 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase20.apache.org,41843,1678575183185] 2023-03-11 22:53:04,519 DEBUG [RS:0;jenkins-hbase20:41843] zookeeper.ZKUtil(162): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:04,528 DEBUG [RS:0;jenkins-hbase20:41843] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-03-11 22:53:04,535 INFO [RS:0;jenkins-hbase20:41843] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-03-11 22:53:04,553 INFO [RS:0;jenkins-hbase20:41843] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-03-11 22:53:04,556 INFO [RS:0;jenkins-hbase20:41843] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-11 22:53:04,556 INFO [RS:0;jenkins-hbase20:41843] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-11 22:53:04,557 INFO [RS:0;jenkins-hbase20:41843] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-03-11 22:53:04,563 INFO [RS:0;jenkins-hbase20:41843] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=100, unit=MILLISECONDS is enabled. 2023-03-11 22:53:04,564 DEBUG [RS:0;jenkins-hbase20:41843] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-03-11 22:53:04,564 DEBUG [RS:0;jenkins-hbase20:41843] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-03-11 22:53:04,564 DEBUG [RS:0;jenkins-hbase20:41843] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-03-11 22:53:04,564 DEBUG [RS:0;jenkins-hbase20:41843] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-03-11 22:53:04,564 DEBUG [RS:0;jenkins-hbase20:41843] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-03-11 22:53:04,565 DEBUG [RS:0;jenkins-hbase20:41843] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-03-11 22:53:04,565 DEBUG [RS:0;jenkins-hbase20:41843] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-03-11 22:53:04,565 DEBUG [RS:0;jenkins-hbase20:41843] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-03-11 22:53:04,565 DEBUG [RS:0;jenkins-hbase20:41843] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-03-11 22:53:04,565 DEBUG [RS:0;jenkins-hbase20:41843] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-03-11 22:53:04,566 INFO [RS:0;jenkins-hbase20:41843] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-03-11 22:53:04,566 INFO [RS:0;jenkins-hbase20:41843] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-03-11 22:53:04,566 INFO [RS:0;jenkins-hbase20:41843] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-03-11 22:53:04,579 INFO [RS:0;jenkins-hbase20:41843] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-03-11 22:53:04,582 INFO [RS:0;jenkins-hbase20:41843] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,41843,1678575183185-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-03-11 22:53:04,595 INFO [RS:0;jenkins-hbase20:41843] regionserver.Replication(203): jenkins-hbase20.apache.org,41843,1678575183185 started 2023-03-11 22:53:04,596 INFO [RS:0;jenkins-hbase20:41843] regionserver.HRegionServer(1638): Serving as jenkins-hbase20.apache.org,41843,1678575183185, RpcServer on jenkins-hbase20.apache.org/148.251.75.209:41843, sessionid=0x1000296b5630001 2023-03-11 22:53:04,596 DEBUG [RS:0;jenkins-hbase20:41843] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-03-11 22:53:04,596 DEBUG [RS:0;jenkins-hbase20:41843] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:04,596 DEBUG [RS:0;jenkins-hbase20:41843] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,41843,1678575183185' 2023-03-11 22:53:04,596 DEBUG [RS:0;jenkins-hbase20:41843] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:53:04,597 DEBUG [RS:0;jenkins-hbase20:41843] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:53:04,597 DEBUG [RS:0;jenkins-hbase20:41843] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-03-11 22:53:04,597 DEBUG [RS:0;jenkins-hbase20:41843] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-03-11 22:53:04,597 DEBUG [RS:0;jenkins-hbase20:41843] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:04,597 DEBUG [RS:0;jenkins-hbase20:41843] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,41843,1678575183185' 2023-03-11 22:53:04,597 DEBUG [RS:0;jenkins-hbase20:41843] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-03-11 22:53:04,598 DEBUG [RS:0;jenkins-hbase20:41843] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-03-11 22:53:04,598 DEBUG [RS:0;jenkins-hbase20:41843] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-03-11 22:53:04,598 INFO [RS:0;jenkins-hbase20:41843] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-03-11 22:53:04,598 INFO [RS:0;jenkins-hbase20:41843] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-03-11 22:53:04,707 INFO [RS:0;jenkins-hbase20:41843] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C41843%2C1678575183185, suffix=, logDir=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/WALs/jenkins-hbase20.apache.org,41843,1678575183185, archiveDir=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/oldWALs, maxLogs=32 2023-03-11 22:53:04,722 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37271,DS-c49b0644-b2ba-4f16-9222-18ee83a20d8c,DISK] 2023-03-11 22:53:04,726 INFO [RS:0;jenkins-hbase20:41843] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/WALs/jenkins-hbase20.apache.org,41843,1678575183185/jenkins-hbase20.apache.org%2C41843%2C1678575183185.1678575184710 2023-03-11 22:53:04,727 DEBUG [RS:0;jenkins-hbase20:41843] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37271,DS-c49b0644-b2ba-4f16-9222-18ee83a20d8c,DISK]] 2023-03-11 22:53:04,839 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-03-11 22:53:04,840 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-03-11 22:53:04,840 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9 2023-03-11 22:53:05,253 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-11 22:53:05,256 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-03-11 22:53:05,260 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/hbase/meta/1588230740/info 2023-03-11 22:53:05,261 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-03-11 22:53:05,262 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-11 22:53:05,262 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-03-11 22:53:05,266 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/hbase/meta/1588230740/rep_barrier 2023-03-11 22:53:05,267 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-03-11 22:53:05,268 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-11 22:53:05,268 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-03-11 22:53:05,270 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/hbase/meta/1588230740/table 2023-03-11 22:53:05,271 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-03-11 22:53:05,272 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-11 22:53:05,274 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/hbase/meta/1588230740 2023-03-11 22:53:05,275 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/hbase/meta/1588230740 2023-03-11 22:53:05,278 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-03-11 22:53:05,280 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-03-11 22:53:05,283 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-11 22:53:05,284 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68647731, jitterRate=0.02293090522289276}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-03-11 22:53:05,285 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-03-11 22:53:05,285 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-03-11 22:53:05,285 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-03-11 22:53:05,285 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-03-11 22:53:05,285 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-03-11 22:53:05,285 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-03-11 22:53:05,286 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-03-11 22:53:05,286 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-03-11 22:53:05,291 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-03-11 22:53:05,291 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-03-11 22:53:05,298 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-03-11 22:53:05,308 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-03-11 22:53:05,310 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-03-11 22:53:05,462 DEBUG [jenkins-hbase20:44347] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=1, allServersCount=1 2023-03-11 22:53:05,464 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,41843,1678575183185, state=OPENING 2023-03-11 22:53:05,470 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-03-11 22:53:05,471 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-03-11 22:53:05,471 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-03-11 22:53:05,474 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,41843,1678575183185}] 2023-03-11 22:53:05,653 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:05,655 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-03-11 22:53:05,659 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:50410, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-03-11 22:53:05,670 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-03-11 22:53:05,670 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-03-11 22:53:05,674 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C41843%2C1678575183185.meta, suffix=.meta, logDir=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/WALs/jenkins-hbase20.apache.org,41843,1678575183185, archiveDir=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/oldWALs, maxLogs=32 2023-03-11 22:53:05,690 DEBUG [RS-EventLoopGroup-3-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37271,DS-c49b0644-b2ba-4f16-9222-18ee83a20d8c,DISK] 2023-03-11 22:53:05,696 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/WALs/jenkins-hbase20.apache.org,41843,1678575183185/jenkins-hbase20.apache.org%2C41843%2C1678575183185.meta.1678575185676.meta 2023-03-11 22:53:05,696 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37271,DS-c49b0644-b2ba-4f16-9222-18ee83a20d8c,DISK]] 2023-03-11 22:53:05,697 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-03-11 22:53:05,699 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-03-11 22:53:05,718 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-03-11 22:53:05,723 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-03-11 22:53:05,728 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-03-11 22:53:05,728 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-11 22:53:05,729 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-03-11 22:53:05,729 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-03-11 22:53:05,732 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-03-11 22:53:05,733 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/hbase/meta/1588230740/info 2023-03-11 22:53:05,733 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/hbase/meta/1588230740/info 2023-03-11 22:53:05,734 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-03-11 22:53:05,735 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-11 22:53:05,735 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-03-11 22:53:05,736 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/hbase/meta/1588230740/rep_barrier 2023-03-11 22:53:05,737 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/hbase/meta/1588230740/rep_barrier 2023-03-11 22:53:05,737 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-03-11 22:53:05,739 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-11 22:53:05,739 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-03-11 22:53:05,741 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/hbase/meta/1588230740/table 2023-03-11 22:53:05,741 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/hbase/meta/1588230740/table 2023-03-11 22:53:05,742 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-03-11 22:53:05,743 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-11 22:53:05,745 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/hbase/meta/1588230740 2023-03-11 22:53:05,748 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/hbase/meta/1588230740 2023-03-11 22:53:05,751 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-03-11 22:53:05,754 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-03-11 22:53:05,755 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73496390, jitterRate=0.09518155455589294}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-03-11 22:53:05,755 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-03-11 22:53:05,764 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1678575185646 2023-03-11 22:53:05,782 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-03-11 22:53:05,783 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-03-11 22:53:05,783 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,41843,1678575183185, state=OPEN 2023-03-11 22:53:05,786 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-03-11 22:53:05,786 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-03-11 22:53:05,790 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-03-11 22:53:05,790 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,41843,1678575183185 in 312 msec 2023-03-11 22:53:05,797 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-03-11 22:53:05,797 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 495 msec 2023-03-11 22:53:05,802 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.4970 sec 2023-03-11 22:53:05,803 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1678575185803, completionTime=-1 2023-03-11 22:53:05,803 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=1; waited=0ms, expected min=1 server(s), max=1 server(s), master is running 2023-03-11 22:53:05,803 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-03-11 22:53:05,864 DEBUG [hconnection-0x43b14446-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-11 22:53:05,868 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:50412, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-11 22:53:05,891 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=1 2023-03-11 22:53:05,891 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1678575245891 2023-03-11 22:53:05,891 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1678575305891 2023-03-11 22:53:05,891 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 88 msec 2023-03-11 22:53:05,916 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,44347,1678575181988-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-03-11 22:53:05,916 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,44347,1678575181988-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-03-11 22:53:05,917 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,44347,1678575181988-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-03-11 22:53:05,918 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase20:44347, period=300000, unit=MILLISECONDS is enabled. 2023-03-11 22:53:05,918 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-03-11 22:53:05,924 DEBUG [master/jenkins-hbase20:0.Chore.1] janitor.CatalogJanitor(175): 2023-03-11 22:53:05,936 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-03-11 22:53:05,938 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-03-11 22:53:05,948 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-03-11 22:53:05,951 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-03-11 22:53:05,954 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-11 22:53:05,982 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/.tmp/data/hbase/namespace/62d6e77362816ea2765a04331be018cd 2023-03-11 22:53:05,985 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/.tmp/data/hbase/namespace/62d6e77362816ea2765a04331be018cd empty. 2023-03-11 22:53:05,986 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/.tmp/data/hbase/namespace/62d6e77362816ea2765a04331be018cd 2023-03-11 22:53:05,986 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-03-11 22:53:06,428 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-03-11 22:53:06,431 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 62d6e77362816ea2765a04331be018cd, NAME => 'hbase:namespace,,1678575185937.62d6e77362816ea2765a04331be018cd.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/.tmp 2023-03-11 22:53:06,845 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1678575185937.62d6e77362816ea2765a04331be018cd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-11 22:53:06,845 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 62d6e77362816ea2765a04331be018cd, disabling compactions & flushes 2023-03-11 22:53:06,845 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1678575185937.62d6e77362816ea2765a04331be018cd. 2023-03-11 22:53:06,845 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1678575185937.62d6e77362816ea2765a04331be018cd. 2023-03-11 22:53:06,845 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1678575185937.62d6e77362816ea2765a04331be018cd. after waiting 0 ms 2023-03-11 22:53:06,845 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1678575185937.62d6e77362816ea2765a04331be018cd. 2023-03-11 22:53:06,845 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1678575185937.62d6e77362816ea2765a04331be018cd. 2023-03-11 22:53:06,845 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 62d6e77362816ea2765a04331be018cd: 2023-03-11 22:53:06,851 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-03-11 22:53:06,870 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1678575185937.62d6e77362816ea2765a04331be018cd.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1678575186854"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678575186854"}]},"ts":"1678575186854"} 2023-03-11 22:53:06,900 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-03-11 22:53:06,902 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-11 22:53:06,908 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678575186903"}]},"ts":"1678575186903"} 2023-03-11 22:53:06,913 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-03-11 22:53:06,923 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=62d6e77362816ea2765a04331be018cd, ASSIGN}] 2023-03-11 22:53:06,926 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=62d6e77362816ea2765a04331be018cd, ASSIGN 2023-03-11 22:53:06,928 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=62d6e77362816ea2765a04331be018cd, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,41843,1678575183185; forceNewPlan=false, retain=false 2023-03-11 22:53:07,079 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=62d6e77362816ea2765a04331be018cd, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:07,079 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1678575185937.62d6e77362816ea2765a04331be018cd.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1678575187079"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1678575187079"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678575187079"}]},"ts":"1678575187079"} 2023-03-11 22:53:07,084 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 62d6e77362816ea2765a04331be018cd, server=jenkins-hbase20.apache.org,41843,1678575183185}] 2023-03-11 22:53:07,245 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1678575185937.62d6e77362816ea2765a04331be018cd. 2023-03-11 22:53:07,246 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 62d6e77362816ea2765a04331be018cd, NAME => 'hbase:namespace,,1678575185937.62d6e77362816ea2765a04331be018cd.', STARTKEY => '', ENDKEY => ''} 2023-03-11 22:53:07,247 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 62d6e77362816ea2765a04331be018cd 2023-03-11 22:53:07,248 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1678575185937.62d6e77362816ea2765a04331be018cd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-11 22:53:07,248 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 62d6e77362816ea2765a04331be018cd 2023-03-11 22:53:07,248 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 62d6e77362816ea2765a04331be018cd 2023-03-11 22:53:07,251 INFO [StoreOpener-62d6e77362816ea2765a04331be018cd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 62d6e77362816ea2765a04331be018cd 2023-03-11 22:53:07,253 DEBUG [StoreOpener-62d6e77362816ea2765a04331be018cd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/hbase/namespace/62d6e77362816ea2765a04331be018cd/info 2023-03-11 22:53:07,253 DEBUG [StoreOpener-62d6e77362816ea2765a04331be018cd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/hbase/namespace/62d6e77362816ea2765a04331be018cd/info 2023-03-11 22:53:07,254 INFO [StoreOpener-62d6e77362816ea2765a04331be018cd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 62d6e77362816ea2765a04331be018cd columnFamilyName info 2023-03-11 22:53:07,255 INFO [StoreOpener-62d6e77362816ea2765a04331be018cd-1] regionserver.HStore(310): Store=62d6e77362816ea2765a04331be018cd/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-11 22:53:07,257 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/hbase/namespace/62d6e77362816ea2765a04331be018cd 2023-03-11 22:53:07,258 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/hbase/namespace/62d6e77362816ea2765a04331be018cd 2023-03-11 22:53:07,263 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 62d6e77362816ea2765a04331be018cd 2023-03-11 22:53:07,267 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/hbase/namespace/62d6e77362816ea2765a04331be018cd/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-11 22:53:07,268 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 62d6e77362816ea2765a04331be018cd; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66881576, jitterRate=-0.003386855125427246}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-11 22:53:07,268 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 62d6e77362816ea2765a04331be018cd: 2023-03-11 22:53:07,270 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1678575185937.62d6e77362816ea2765a04331be018cd., pid=6, masterSystemTime=1678575187238 2023-03-11 22:53:07,274 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1678575185937.62d6e77362816ea2765a04331be018cd. 2023-03-11 22:53:07,275 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1678575185937.62d6e77362816ea2765a04331be018cd. 2023-03-11 22:53:07,276 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=62d6e77362816ea2765a04331be018cd, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:07,277 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1678575185937.62d6e77362816ea2765a04331be018cd.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1678575187275"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1678575187275"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678575187275"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678575187275"}]},"ts":"1678575187275"} 2023-03-11 22:53:07,285 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-03-11 22:53:07,285 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 62d6e77362816ea2765a04331be018cd, server=jenkins-hbase20.apache.org,41843,1678575183185 in 197 msec 2023-03-11 22:53:07,289 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-03-11 22:53:07,290 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=62d6e77362816ea2765a04331be018cd, ASSIGN in 362 msec 2023-03-11 22:53:07,292 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-11 22:53:07,292 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678575187292"}]},"ts":"1678575187292"} 2023-03-11 22:53:07,296 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-03-11 22:53:07,299 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-03-11 22:53:07,302 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 1.3610 sec 2023-03-11 22:53:07,353 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-03-11 22:53:07,354 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-03-11 22:53:07,354 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-03-11 22:53:07,392 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-03-11 22:53:07,415 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-03-11 22:53:07,423 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 40 msec 2023-03-11 22:53:07,428 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-03-11 22:53:07,440 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-03-11 22:53:07,446 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 16 msec 2023-03-11 22:53:07,456 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-03-11 22:53:07,458 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-03-11 22:53:07,459 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 4.197sec 2023-03-11 22:53:07,460 INFO [master/jenkins-hbase20:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-03-11 22:53:07,462 INFO [master/jenkins-hbase20:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-03-11 22:53:07,462 INFO [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-03-11 22:53:07,463 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,44347,1678575181988-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-03-11 22:53:07,464 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,44347,1678575181988-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-03-11 22:53:07,473 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-03-11 22:53:07,537 DEBUG [Listener at localhost.localdomain/41563] zookeeper.ReadOnlyZKClient(139): Connect 0x54237440 to 127.0.0.1:51815 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-11 22:53:07,541 DEBUG [Listener at localhost.localdomain/41563] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@25d11621, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-11 22:53:07,554 DEBUG [hconnection-0xe96b5f8-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-11 22:53:07,564 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:50428, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-11 22:53:07,590 INFO [Listener at localhost.localdomain/41563] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase20.apache.org,44347,1678575181988 2023-03-11 22:53:07,591 DEBUG [Listener at localhost.localdomain/41563] zookeeper.ReadOnlyZKClient(139): Connect 0x5849430e to 127.0.0.1:51815 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-11 22:53:07,595 DEBUG [Listener at localhost.localdomain/41563] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@17bfc7db, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-11 22:53:07,596 INFO [Listener at localhost.localdomain/41563] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-03-11 22:53:07,617 INFO [Listener at localhost.localdomain/41563] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthly Thread=211, OpenFileDescriptor=475, MaxFileDescriptor=60000, SystemLoadAverage=335, ProcessCount=168, AvailableMemoryMB=22251 2023-03-11 22:53:07,629 DEBUG [Listener at localhost.localdomain/41563] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-11 22:53:07,633 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:48820, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-11 22:53:07,646 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-03-11 22:53:07,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:07,650 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_PRE_OPERATION 2023-03-11 22:53:07,653 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-11 22:53:07,654 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(697): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthly" procId is: 9 2023-03-11 22:53:07,656 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936 2023-03-11 22:53:07,657 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936 empty. 2023-03-11 22:53:07,659 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936 2023-03-11 22:53:07,659 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthly regions 2023-03-11 22:53:07,664 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-03-11 22:53:07,676 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000001 2023-03-11 22:53:07,677 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(7675): creating {ENCODED => 39bbacab0d97c013b0afb55b77408936, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1678575187642.39bbacab0d97c013b0afb55b77408936.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/.tmp 2023-03-11 22:53:07,770 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-03-11 22:53:07,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-03-11 22:53:08,090 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1678575187642.39bbacab0d97c013b0afb55b77408936.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-11 22:53:08,090 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1604): Closing 39bbacab0d97c013b0afb55b77408936, disabling compactions & flushes 2023-03-11 22:53:08,090 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1678575187642.39bbacab0d97c013b0afb55b77408936. 2023-03-11 22:53:08,090 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1678575187642.39bbacab0d97c013b0afb55b77408936. 2023-03-11 22:53:08,090 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1678575187642.39bbacab0d97c013b0afb55b77408936. after waiting 0 ms 2023-03-11 22:53:08,091 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1678575187642.39bbacab0d97c013b0afb55b77408936. 2023-03-11 22:53:08,091 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1678575187642.39bbacab0d97c013b0afb55b77408936. 2023-03-11 22:53:08,091 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1558): Region close journal for 39bbacab0d97c013b0afb55b77408936: 2023-03-11 22:53:08,095 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_ADD_TO_META 2023-03-11 22:53:08,096 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1678575187642.39bbacab0d97c013b0afb55b77408936.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1678575188096"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678575188096"}]},"ts":"1678575188096"} 2023-03-11 22:53:08,099 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-03-11 22:53:08,101 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-11 22:53:08,101 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678575188101"}]},"ts":"1678575188101"} 2023-03-11 22:53:08,104 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthly, state=ENABLING in hbase:meta 2023-03-11 22:53:08,107 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=39bbacab0d97c013b0afb55b77408936, ASSIGN}] 2023-03-11 22:53:08,109 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=39bbacab0d97c013b0afb55b77408936, ASSIGN 2023-03-11 22:53:08,111 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=39bbacab0d97c013b0afb55b77408936, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,41843,1678575183185; forceNewPlan=false, retain=false 2023-03-11 22:53:08,262 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=39bbacab0d97c013b0afb55b77408936, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:08,263 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1678575187642.39bbacab0d97c013b0afb55b77408936.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1678575188262"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1678575188262"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678575188262"}]},"ts":"1678575188262"} 2023-03-11 22:53:08,266 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 39bbacab0d97c013b0afb55b77408936, server=jenkins-hbase20.apache.org,41843,1678575183185}] 2023-03-11 22:53:08,274 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-03-11 22:53:08,425 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthly,,1678575187642.39bbacab0d97c013b0afb55b77408936. 2023-03-11 22:53:08,425 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 39bbacab0d97c013b0afb55b77408936, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1678575187642.39bbacab0d97c013b0afb55b77408936.', STARTKEY => '', ENDKEY => ''} 2023-03-11 22:53:08,426 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthly 39bbacab0d97c013b0afb55b77408936 2023-03-11 22:53:08,426 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1678575187642.39bbacab0d97c013b0afb55b77408936.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-11 22:53:08,426 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 39bbacab0d97c013b0afb55b77408936 2023-03-11 22:53:08,426 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 39bbacab0d97c013b0afb55b77408936 2023-03-11 22:53:08,429 INFO [StoreOpener-39bbacab0d97c013b0afb55b77408936-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 39bbacab0d97c013b0afb55b77408936 2023-03-11 22:53:08,431 DEBUG [StoreOpener-39bbacab0d97c013b0afb55b77408936-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936/family1 2023-03-11 22:53:08,431 DEBUG [StoreOpener-39bbacab0d97c013b0afb55b77408936-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936/family1 2023-03-11 22:53:08,434 INFO [StoreOpener-39bbacab0d97c013b0afb55b77408936-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 39bbacab0d97c013b0afb55b77408936 columnFamilyName family1 2023-03-11 22:53:08,437 INFO [StoreOpener-39bbacab0d97c013b0afb55b77408936-1] regionserver.HStore(310): Store=39bbacab0d97c013b0afb55b77408936/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-11 22:53:08,439 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936 2023-03-11 22:53:08,440 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936 2023-03-11 22:53:08,444 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 39bbacab0d97c013b0afb55b77408936 2023-03-11 22:53:08,448 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-11 22:53:08,449 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 39bbacab0d97c013b0afb55b77408936; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73701379, jitterRate=0.09823612868785858}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-11 22:53:08,449 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 39bbacab0d97c013b0afb55b77408936: 2023-03-11 22:53:08,451 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthly,,1678575187642.39bbacab0d97c013b0afb55b77408936., pid=11, masterSystemTime=1678575188420 2023-03-11 22:53:08,454 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthly,,1678575187642.39bbacab0d97c013b0afb55b77408936. 2023-03-11 22:53:08,454 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthly,,1678575187642.39bbacab0d97c013b0afb55b77408936. 2023-03-11 22:53:08,455 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=39bbacab0d97c013b0afb55b77408936, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:08,455 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1678575187642.39bbacab0d97c013b0afb55b77408936.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1678575188455"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1678575188455"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678575188455"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678575188455"}]},"ts":"1678575188455"} 2023-03-11 22:53:08,462 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-03-11 22:53:08,462 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 39bbacab0d97c013b0afb55b77408936, server=jenkins-hbase20.apache.org,41843,1678575183185 in 192 msec 2023-03-11 22:53:08,466 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-03-11 22:53:08,466 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=39bbacab0d97c013b0afb55b77408936, ASSIGN in 355 msec 2023-03-11 22:53:08,468 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-11 22:53:08,468 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678575188468"}]},"ts":"1678575188468"} 2023-03-11 22:53:08,471 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthly, state=ENABLED in hbase:meta 2023-03-11 22:53:08,474 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_POST_OPERATION 2023-03-11 22:53:08,477 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 828 msec 2023-03-11 22:53:08,776 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-03-11 22:53:08,776 INFO [Listener at localhost.localdomain/41563] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthly, procId: 9 completed 2023-03-11 22:53:08,797 DEBUG [hconnection-0x57c9cf77-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-11 22:53:08,801 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:50444, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-11 22:53:08,991 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-11 22:53:09,001 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:09,002 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-11 22:53:09,002 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:53:09,002 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-03-11 22:53:09,002 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-03-11 22:53:09,003 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:09,003 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:09,004 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:53:09,004 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:09,004 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:53:09,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:53:09,005 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:09,005 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 22:53:09,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:09,005 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:09,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 22:53:09,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:09,006 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:09,008 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:09,010 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-03-11 22:53:09,010 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:53:09,011 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-03-11 22:53:09,014 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 22:53:09,014 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1678575187642.39bbacab0d97c013b0afb55b77408936. 2023-03-11 22:53:09,014 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 22:53:09,015 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1678575187642.39bbacab0d97c013b0afb55b77408936. started... 2023-03-11 22:53:09,016 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 39bbacab0d97c013b0afb55b77408936 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-03-11 22:53:09,609 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511305e8853c51e0443dda2ca1d9db5f05b0d to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511305e8853c51e0443dda2ca1d9db5f05b0d 2023-03-11 22:53:10,023 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936/.tmp/family1/1c16d93822694093805eb7788ffc250a 2023-03-11 22:53:10,045 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936/.tmp/family1/1c16d93822694093805eb7788ffc250a as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936/family1/1c16d93822694093805eb7788ffc250a 2023-03-11 22:53:10,063 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936/family1/1c16d93822694093805eb7788ffc250a, entries=1000, sequenceid=5, filesize=175.8 K 2023-03-11 22:53:10,066 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 39bbacab0d97c013b0afb55b77408936 in 1049ms, sequenceid=5, compaction requested=false 2023-03-11 22:53:10,067 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-11 22:53:10,073 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 39bbacab0d97c013b0afb55b77408936: 2023-03-11 22:53:10,073 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1678575187642.39bbacab0d97c013b0afb55b77408936. 2023-03-11 22:53:10,073 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 22:53:10,074 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 22:53:10,074 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:10,074 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-03-11 22:53:10,074 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-03-11 22:53:10,075 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:10,075 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:10,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:10,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:53:10,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:53:10,076 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:10,076 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 22:53:10,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:53:10,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:53:10,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:10,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:10,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:53:10,078 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-03-11 22:53:10,078 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7b501de3[Count = 0] remaining members to acquire global barrier 2023-03-11 22:53:10,078 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-03-11 22:53:10,078 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:10,079 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:10,080 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:10,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:10,080 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-03-11 22:53:10,080 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-03-11 22:53:10,080 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,41843,1678575183185' in zk 2023-03-11 22:53:10,082 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:10,082 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 22:53:10,083 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-03-11 22:53:10,083 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:53:10,083 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-03-11 22:53:10,084 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:10,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:10,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:53:10,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:53:10,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:53:10,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:53:10,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:10,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:10,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:53:10,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:10,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:10,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,41843,1678575183185': 2023-03-11 22:53:10,088 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-03-11 22:53:10,088 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-03-11 22:53:10,088 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 22:53:10,088 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 22:53:10,088 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:10,088 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 22:53:10,097 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:10,097 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:53:10,097 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:10,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:10,097 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:10,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:10,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:53:10,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:53:10,098 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:53:10,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:53:10,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:53:10,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:10,099 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:10,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:10,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:53:10,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:10,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:10,102 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:10,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:53:10,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:10,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:10,110 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:53:10,110 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:53:10,110 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:53:10,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:53:10,111 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:53:10,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:53:10,111 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:10,111 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:10,111 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:10,111 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:10,111 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:10,111 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:10,111 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:10,113 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:53:10,113 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-11 22:53:10,114 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 22:53:10,116 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-03-11 22:53:10,116 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 22:53:10,216 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 22:53:10,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 22:53:10,230 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-11 22:53:10,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-03-11 22:53:10,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:10,242 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-11 22:53:10,242 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:53:10,243 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-03-11 22:53:10,243 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-03-11 22:53:10,243 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:10,243 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:10,244 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:53:10,244 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:10,244 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:53:10,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:53:10,245 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:10,245 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 22:53:10,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:10,245 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:10,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 22:53:10,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:10,246 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:10,250 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-03-11 22:53:10,250 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:10,250 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-03-11 22:53:10,250 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:53:10,250 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-03-11 22:53:10,252 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 22:53:10,252 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 22:53:10,253 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1678575187642.39bbacab0d97c013b0afb55b77408936. 2023-03-11 22:53:10,253 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1678575187642.39bbacab0d97c013b0afb55b77408936. started... 2023-03-11 22:53:10,253 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 39bbacab0d97c013b0afb55b77408936 1/1 column families, dataSize=74 B heapSize=408 B 2023-03-11 22:53:10,326 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511289b6fd981bedc4f0db38b204b3204f1d7 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511289b6fd981bedc4f0db38b204b3204f1d7 2023-03-11 22:53:10,364 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936/.tmp/family1/41815a2dddb34fbbbb69002227c8b47b 2023-03-11 22:53:10,372 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936/.tmp/family1/41815a2dddb34fbbbb69002227c8b47b as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936/family1/41815a2dddb34fbbbb69002227c8b47b 2023-03-11 22:53:10,381 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936/family1/41815a2dddb34fbbbb69002227c8b47b, entries=1, sequenceid=9, filesize=5.0 K 2023-03-11 22:53:10,382 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 39bbacab0d97c013b0afb55b77408936 in 129ms, sequenceid=9, compaction requested=false 2023-03-11 22:53:10,382 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 39bbacab0d97c013b0afb55b77408936: 2023-03-11 22:53:10,382 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1678575187642.39bbacab0d97c013b0afb55b77408936. 2023-03-11 22:53:10,382 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 22:53:10,383 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 22:53:10,383 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:10,383 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-03-11 22:53:10,383 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-03-11 22:53:10,409 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:10,409 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:10,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:10,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:53:10,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:53:10,410 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:10,410 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 22:53:10,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:53:10,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:53:10,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:10,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:10,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:53:10,412 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-03-11 22:53:10,412 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-03-11 22:53:10,412 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@8c910e8[Count = 0] remaining members to acquire global barrier 2023-03-11 22:53:10,412 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:10,426 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:10,426 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:10,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:10,427 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-03-11 22:53:10,427 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-03-11 22:53:10,427 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:10,427 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 22:53:10,427 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,41843,1678575183185' in zk 2023-03-11 22:53:10,430 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:10,430 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-03-11 22:53:10,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:10,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:53:10,430 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:53:10,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:53:10,430 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-03-11 22:53:10,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:53:10,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:53:10,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:10,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:10,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:53:10,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:10,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:10,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,41843,1678575183185': 2023-03-11 22:53:10,433 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-03-11 22:53:10,433 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-03-11 22:53:10,433 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 22:53:10,433 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 22:53:10,433 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:10,433 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 22:53:10,435 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:10,435 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:10,435 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:10,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:10,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:53:10,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:10,435 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:53:10,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:53:10,435 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:53:10,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:53:10,435 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:10,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:53:10,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:10,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:10,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:53:10,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:10,437 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:10,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:10,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:53:10,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:10,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:10,440 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:10,440 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:10,440 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:53:10,440 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:53:10,440 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:53:10,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:53:10,440 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:53:10,440 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-11 22:53:10,441 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-03-11 22:53:10,441 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 22:53:10,441 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:10,441 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:10,441 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:53:10,441 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:10,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:53:10,441 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:10,441 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:10,441 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-03-11 22:53:10,441 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 22:53:10,532 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-03-11 22:53:10,533 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-03-11 22:53:10,541 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 22:53:10,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 22:53:10,552 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-11 22:53:10,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-03-11 22:53:10,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:10,569 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-11 22:53:10,569 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:53:10,570 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-03-11 22:53:10,570 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-03-11 22:53:10,570 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:10,571 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:10,572 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:53:10,572 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:10,572 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:53:10,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:53:10,572 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:10,572 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 22:53:10,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:10,573 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:10,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 22:53:10,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:10,573 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:10,576 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-03-11 22:53:10,576 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:10,576 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-03-11 22:53:10,576 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:53:10,577 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-03-11 22:53:10,578 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 22:53:10,578 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 22:53:10,653 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1678575187642.39bbacab0d97c013b0afb55b77408936. 2023-03-11 22:53:10,653 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1678575187642.39bbacab0d97c013b0afb55b77408936. started... 2023-03-11 22:53:10,653 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 39bbacab0d97c013b0afb55b77408936 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-11 22:53:11,172 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512010286ab3a58dc49f1bd20ee71b2363700 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512010286ab3a58dc49f1bd20ee71b2363700 2023-03-11 22:53:11,269 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-11 22:53:11,586 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936/.tmp/family1/96e26c254f814d5fb69096ae1bdd8554 2023-03-11 22:53:11,597 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936/.tmp/family1/96e26c254f814d5fb69096ae1bdd8554 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936/family1/96e26c254f814d5fb69096ae1bdd8554 2023-03-11 22:53:11,607 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936/family1/96e26c254f814d5fb69096ae1bdd8554, entries=1, sequenceid=13, filesize=5.0 K 2023-03-11 22:53:11,609 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 39bbacab0d97c013b0afb55b77408936 in 956ms, sequenceid=13, compaction requested=true 2023-03-11 22:53:11,609 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 39bbacab0d97c013b0afb55b77408936: 2023-03-11 22:53:11,609 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1678575187642.39bbacab0d97c013b0afb55b77408936. 2023-03-11 22:53:11,609 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 22:53:11,610 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 22:53:11,610 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:11,610 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-03-11 22:53:11,610 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-03-11 22:53:11,612 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:11,612 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:11,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:11,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:53:11,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:53:11,612 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:11,612 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 22:53:11,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:53:11,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:53:11,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:11,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:11,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:53:11,614 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-03-11 22:53:11,614 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2c324e0b[Count = 0] remaining members to acquire global barrier 2023-03-11 22:53:11,614 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-03-11 22:53:11,614 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:11,614 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:11,614 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:11,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:11,615 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-03-11 22:53:11,615 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:11,615 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 22:53:11,615 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-03-11 22:53:11,615 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,41843,1678575183185' in zk 2023-03-11 22:53:11,616 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-03-11 22:53:11,616 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:11,616 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:53:11,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:11,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:53:11,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:53:11,616 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-03-11 22:53:11,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:53:11,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:53:11,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:11,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:11,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:53:11,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:11,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:11,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,41843,1678575183185': 2023-03-11 22:53:11,619 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-03-11 22:53:11,619 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-03-11 22:53:11,619 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 22:53:11,619 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 22:53:11,619 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:11,619 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 22:53:11,621 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:11,621 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:53:11,621 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:11,621 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:11,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:11,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:11,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:53:11,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:53:11,621 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:53:11,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:53:11,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:53:11,622 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:11,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:11,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:11,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:53:11,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:11,623 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:11,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:11,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:53:11,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:11,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:11,647 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:11,647 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:53:11,647 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:11,647 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-11 22:53:11,647 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:53:11,647 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:53:11,647 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:53:11,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:53:11,648 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 22:53:11,648 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-03-11 22:53:11,647 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:11,648 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:11,648 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:11,649 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:11,649 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:11,649 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:53:11,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:53:11,649 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-03-11 22:53:11,649 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 22:53:11,749 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 22:53:11,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 22:53:11,758 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-11 22:53:11,760 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-03-11 22:53:11,760 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:11,760 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-11 22:53:11,760 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:53:11,761 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-03-11 22:53:11,761 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-03-11 22:53:11,761 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:11,761 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:11,762 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:53:11,762 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:11,762 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:53:11,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:53:11,763 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:11,763 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 22:53:11,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:11,763 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:11,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 22:53:11,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:11,763 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:11,764 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-03-11 22:53:11,764 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:11,764 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-03-11 22:53:11,764 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:53:11,764 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-03-11 22:53:11,764 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 22:53:11,764 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 22:53:11,764 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1678575187642.39bbacab0d97c013b0afb55b77408936. 2023-03-11 22:53:11,765 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1678575187642.39bbacab0d97c013b0afb55b77408936. started... 2023-03-11 22:53:11,765 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 39bbacab0d97c013b0afb55b77408936 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-11 22:53:11,792 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205ffde72c4ec41459782727c791340348a to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205ffde72c4ec41459782727c791340348a 2023-03-11 22:53:12,161 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-03-11 22:53:12,162 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-03-11 22:53:12,204 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936/.tmp/family1/6829deea2fc7485e8cb9231eae54aeb3 2023-03-11 22:53:12,213 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936/.tmp/family1/6829deea2fc7485e8cb9231eae54aeb3 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936/family1/6829deea2fc7485e8cb9231eae54aeb3 2023-03-11 22:53:12,223 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936/family1/6829deea2fc7485e8cb9231eae54aeb3, entries=1, sequenceid=17, filesize=5.0 K 2023-03-11 22:53:12,224 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 39bbacab0d97c013b0afb55b77408936 in 459ms, sequenceid=17, compaction requested=true 2023-03-11 22:53:12,225 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 39bbacab0d97c013b0afb55b77408936: 2023-03-11 22:53:12,225 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1678575187642.39bbacab0d97c013b0afb55b77408936. 2023-03-11 22:53:12,225 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 22:53:12,225 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 22:53:12,225 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:12,225 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-03-11 22:53:12,225 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-03-11 22:53:12,227 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:12,227 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:12,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:12,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:53:12,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:53:12,228 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:12,228 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 22:53:12,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:53:12,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:53:12,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:12,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:12,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:53:12,230 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-03-11 22:53:12,230 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@42f5f5dd[Count = 0] remaining members to acquire global barrier 2023-03-11 22:53:12,230 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-03-11 22:53:12,230 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:12,231 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:12,231 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:12,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:12,231 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-03-11 22:53:12,231 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-03-11 22:53:12,231 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,41843,1678575183185' in zk 2023-03-11 22:53:12,232 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:12,232 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 22:53:12,233 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:12,233 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-03-11 22:53:12,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:12,233 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:53:12,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:53:12,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:53:12,233 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-03-11 22:53:12,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:53:12,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:53:12,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:12,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:12,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:53:12,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:12,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:12,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,41843,1678575183185': 2023-03-11 22:53:12,238 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-03-11 22:53:12,238 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-03-11 22:53:12,238 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 22:53:12,238 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 22:53:12,238 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:12,238 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 22:53:12,247 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:12,247 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:12,247 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:53:12,247 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:12,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:12,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:53:12,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:53:12,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:12,248 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:53:12,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:53:12,248 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:12,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:53:12,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:12,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:12,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:53:12,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:12,250 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:12,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:12,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:53:12,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:12,256 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:53:12,256 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:12,256 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:53:12,256 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:53:12,257 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:12,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:53:12,257 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:12,257 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:12,257 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:12,257 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:12,257 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:12,257 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:53:12,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:53:12,257 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:53:12,257 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-11 22:53:12,258 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 22:53:12,258 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-03-11 22:53:12,259 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 22:53:12,259 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-03-11 22:53:12,359 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 22:53:12,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 22:53:12,367 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-11 22:53:12,369 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-03-11 22:53:12,369 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:12,370 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-11 22:53:12,370 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:53:12,370 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-03-11 22:53:12,370 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-03-11 22:53:12,371 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:12,371 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:12,372 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:53:12,372 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:12,372 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:53:12,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:53:12,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:12,372 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:12,372 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 22:53:12,373 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:12,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 22:53:12,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:12,373 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:12,373 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-03-11 22:53:12,373 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:12,373 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-03-11 22:53:12,373 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:53:12,374 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-03-11 22:53:12,374 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 22:53:12,374 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 22:53:12,374 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1678575187642.39bbacab0d97c013b0afb55b77408936. 2023-03-11 22:53:12,374 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1678575187642.39bbacab0d97c013b0afb55b77408936. started... 2023-03-11 22:53:12,374 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 39bbacab0d97c013b0afb55b77408936 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-11 22:53:12,396 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015122866b7d73170404c67ba2ff4ef03a529ec to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015122866b7d73170404c67ba2ff4ef03a529ec 2023-03-11 22:53:12,808 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936/.tmp/family1/c352d084933f49f7aedf34dc68f82da9 2023-03-11 22:53:12,817 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936/.tmp/family1/c352d084933f49f7aedf34dc68f82da9 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936/family1/c352d084933f49f7aedf34dc68f82da9 2023-03-11 22:53:12,826 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936/family1/c352d084933f49f7aedf34dc68f82da9, entries=1, sequenceid=21, filesize=5.0 K 2023-03-11 22:53:12,827 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 39bbacab0d97c013b0afb55b77408936 in 453ms, sequenceid=21, compaction requested=true 2023-03-11 22:53:12,827 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 39bbacab0d97c013b0afb55b77408936: 2023-03-11 22:53:12,827 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1678575187642.39bbacab0d97c013b0afb55b77408936. 2023-03-11 22:53:12,827 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 22:53:12,828 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 22:53:12,828 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:12,828 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-03-11 22:53:12,828 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-03-11 22:53:12,830 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:12,831 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:12,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:12,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:53:12,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:53:12,831 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:12,831 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 22:53:12,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:53:12,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:53:12,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:12,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:12,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:53:12,832 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-03-11 22:53:12,832 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@39b15765[Count = 0] remaining members to acquire global barrier 2023-03-11 22:53:12,832 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-03-11 22:53:12,833 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:12,833 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:12,833 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:12,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:12,833 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-03-11 22:53:12,834 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-03-11 22:53:12,834 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,41843,1678575183185' in zk 2023-03-11 22:53:12,834 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:12,834 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 22:53:12,834 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:12,834 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-03-11 22:53:12,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:12,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:53:12,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:53:12,835 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:53:12,835 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-03-11 22:53:12,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:53:12,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:53:12,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:12,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:12,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:53:12,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:12,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:12,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,41843,1678575183185': 2023-03-11 22:53:12,837 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-03-11 22:53:12,837 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-03-11 22:53:12,837 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 22:53:12,837 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 22:53:12,837 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:12,837 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 22:53:12,838 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:12,838 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:12,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:12,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:53:12,839 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:12,839 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:53:12,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:12,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:53:12,839 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:53:12,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:53:12,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:53:12,839 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:12,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:12,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:12,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:53:12,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:12,840 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:12,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:12,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:53:12,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:12,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:12,842 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:12,842 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:53:12,842 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:12,842 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:12,842 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:12,842 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:53:12,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:53:12,842 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:12,842 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-11 22:53:12,842 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 22:53:12,842 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:53:12,842 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:12,842 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:53:12,843 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:12,843 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-03-11 22:53:12,843 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:53:12,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:53:12,843 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-03-11 22:53:12,843 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 22:53:12,944 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 22:53:12,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 22:53:12,952 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-11 22:53:12,955 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-03-11 22:53:12,955 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:12,955 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-11 22:53:12,955 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:53:12,955 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-03-11 22:53:12,955 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-03-11 22:53:12,956 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:12,956 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:12,957 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:12,957 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:53:12,957 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:53:12,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:53:12,957 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:12,957 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 22:53:12,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:12,958 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:12,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 22:53:12,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:12,958 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:12,959 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-03-11 22:53:12,959 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:12,959 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-03-11 22:53:12,959 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:53:12,959 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-03-11 22:53:12,959 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 22:53:12,959 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 22:53:12,959 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1678575187642.39bbacab0d97c013b0afb55b77408936. 2023-03-11 22:53:12,960 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1678575187642.39bbacab0d97c013b0afb55b77408936. started... 2023-03-11 22:53:12,960 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 39bbacab0d97c013b0afb55b77408936 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-11 22:53:13,382 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231b5d732f256ba419eb308522b61c23c13 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151231b5d732f256ba419eb308522b61c23c13 2023-03-11 22:53:13,395 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936/.tmp/family1/01ece4d1ba3042eaa3eea19493009a69 2023-03-11 22:53:13,407 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936/.tmp/family1/01ece4d1ba3042eaa3eea19493009a69 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936/family1/01ece4d1ba3042eaa3eea19493009a69 2023-03-11 22:53:13,416 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936/family1/01ece4d1ba3042eaa3eea19493009a69, entries=1, sequenceid=25, filesize=5.0 K 2023-03-11 22:53:13,417 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 39bbacab0d97c013b0afb55b77408936 in 457ms, sequenceid=25, compaction requested=true 2023-03-11 22:53:13,417 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 39bbacab0d97c013b0afb55b77408936: 2023-03-11 22:53:13,417 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1678575187642.39bbacab0d97c013b0afb55b77408936. 2023-03-11 22:53:13,417 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 22:53:13,418 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 22:53:13,418 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:13,418 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-03-11 22:53:13,418 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-03-11 22:53:13,419 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:13,419 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:13,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:13,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:53:13,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:53:13,419 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:13,420 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 22:53:13,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:53:13,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:53:13,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:13,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:13,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:53:13,421 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-03-11 22:53:13,421 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@793f4eeb[Count = 0] remaining members to acquire global barrier 2023-03-11 22:53:13,421 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-03-11 22:53:13,422 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:13,422 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:13,422 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:13,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:13,423 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-03-11 22:53:13,423 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-03-11 22:53:13,423 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,41843,1678575183185' in zk 2023-03-11 22:53:13,423 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:13,423 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 22:53:13,424 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-03-11 22:53:13,424 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:53:13,424 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:13,424 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-03-11 22:53:13,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:13,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:53:13,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:53:13,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:53:13,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:53:13,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:13,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:13,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:53:13,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:13,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:13,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,41843,1678575183185': 2023-03-11 22:53:13,427 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-03-11 22:53:13,427 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-03-11 22:53:13,427 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 22:53:13,427 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 22:53:13,427 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:13,428 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 22:53:13,430 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:13,430 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:13,430 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:13,430 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:53:13,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:13,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:13,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:53:13,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:53:13,431 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:13,431 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:53:13,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:53:13,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:53:13,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:13,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:13,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:53:13,432 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:13,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:13,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:13,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:53:13,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:13,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:13,438 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:53:13,439 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:13,439 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:53:13,439 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:13,439 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:53:13,439 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:53:13,439 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-11 22:53:13,439 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 22:53:13,439 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:13,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:53:13,439 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:13,440 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:13,440 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:13,440 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:13,440 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-03-11 22:53:13,440 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:53:13,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:53:13,440 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-03-11 22:53:13,440 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 22:53:13,540 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 22:53:13,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 22:53:13,549 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-11 22:53:13,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-03-11 22:53:13,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:13,551 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-11 22:53:13,551 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:53:13,552 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-03-11 22:53:13,552 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-03-11 22:53:13,552 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:13,552 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:13,553 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:13,553 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:53:13,553 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:53:13,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:53:13,554 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:13,554 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 22:53:13,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:13,554 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:13,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 22:53:13,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:13,554 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:13,555 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-03-11 22:53:13,555 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:13,555 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-03-11 22:53:13,555 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:53:13,555 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-03-11 22:53:13,555 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 22:53:13,556 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 22:53:13,556 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1678575187642.39bbacab0d97c013b0afb55b77408936. 2023-03-11 22:53:13,556 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1678575187642.39bbacab0d97c013b0afb55b77408936. started... 2023-03-11 22:53:13,556 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 39bbacab0d97c013b0afb55b77408936 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-11 22:53:13,982 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601015916ec9d430c4e58ad6860e0cf509114 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201601015916ec9d430c4e58ad6860e0cf509114 2023-03-11 22:53:14,419 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936/.tmp/family1/15659b8dd4f94daca92d8710e147449a 2023-03-11 22:53:14,428 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936/.tmp/family1/15659b8dd4f94daca92d8710e147449a as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936/family1/15659b8dd4f94daca92d8710e147449a 2023-03-11 22:53:14,437 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936/family1/15659b8dd4f94daca92d8710e147449a, entries=1, sequenceid=29, filesize=5.0 K 2023-03-11 22:53:14,439 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 39bbacab0d97c013b0afb55b77408936 in 883ms, sequenceid=29, compaction requested=true 2023-03-11 22:53:14,439 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 39bbacab0d97c013b0afb55b77408936: 2023-03-11 22:53:14,439 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1678575187642.39bbacab0d97c013b0afb55b77408936. 2023-03-11 22:53:14,439 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 22:53:14,440 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 22:53:14,440 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:14,440 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-03-11 22:53:14,440 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-03-11 22:53:14,441 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:14,441 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:14,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:14,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:53:14,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:53:14,442 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:14,442 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 22:53:14,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:53:14,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:53:14,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:14,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:14,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:53:14,443 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-03-11 22:53:14,443 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@474305d1[Count = 0] remaining members to acquire global barrier 2023-03-11 22:53:14,443 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-03-11 22:53:14,444 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:14,444 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:14,445 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:14,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:14,445 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-03-11 22:53:14,445 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-03-11 22:53:14,445 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,41843,1678575183185' in zk 2023-03-11 22:53:14,445 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:14,445 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 22:53:14,446 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-03-11 22:53:14,446 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:53:14,446 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-03-11 22:53:14,447 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:14,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:14,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:53:14,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:53:14,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:53:14,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:53:14,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:14,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:14,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:53:14,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:14,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:14,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,41843,1678575183185': 2023-03-11 22:53:14,449 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-03-11 22:53:14,449 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-03-11 22:53:14,449 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 22:53:14,449 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 22:53:14,449 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:14,449 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 22:53:14,451 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:14,451 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:14,451 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:14,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:14,451 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:53:14,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:14,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:53:14,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:53:14,451 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:53:14,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:53:14,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:53:14,452 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:14,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:14,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:14,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:53:14,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:14,453 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:14,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:14,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:53:14,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:14,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:14,455 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:14,455 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:14,456 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:14,456 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:53:14,456 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-11 22:53:14,456 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 22:53:14,456 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:14,456 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:53:14,456 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:14,456 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:53:14,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:53:14,456 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:53:14,456 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-03-11 22:53:14,457 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-03-11 22:53:14,456 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:14,457 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 22:53:14,457 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:53:14,457 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:14,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:53:14,557 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 22:53:14,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 22:53:14,565 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-11 22:53:14,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-03-11 22:53:14,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:14,568 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-11 22:53:14,568 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:53:14,568 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-03-11 22:53:14,569 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-03-11 22:53:14,569 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:14,569 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:14,570 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:53:14,570 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:14,570 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:53:14,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:53:14,570 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:14,570 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 22:53:14,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:14,571 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:14,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 22:53:14,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:14,571 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:14,571 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-03-11 22:53:14,572 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:14,572 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-03-11 22:53:14,572 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:53:14,572 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-03-11 22:53:14,572 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 22:53:14,572 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 22:53:14,572 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1678575187642.39bbacab0d97c013b0afb55b77408936. 2023-03-11 22:53:14,572 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1678575187642.39bbacab0d97c013b0afb55b77408936. started... 2023-03-11 22:53:14,573 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 39bbacab0d97c013b0afb55b77408936 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-11 22:53:14,604 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601039300720214854da5bb6de1464d3da7ee to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201601039300720214854da5bb6de1464d3da7ee 2023-03-11 22:53:14,616 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936/.tmp/family1/8d320fb73c5b4730b0734cafa33bd640 2023-03-11 22:53:14,625 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936/.tmp/family1/8d320fb73c5b4730b0734cafa33bd640 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936/family1/8d320fb73c5b4730b0734cafa33bd640 2023-03-11 22:53:14,634 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936/family1/8d320fb73c5b4730b0734cafa33bd640, entries=1, sequenceid=33, filesize=5.0 K 2023-03-11 22:53:14,635 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 39bbacab0d97c013b0afb55b77408936 in 62ms, sequenceid=33, compaction requested=true 2023-03-11 22:53:14,636 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 39bbacab0d97c013b0afb55b77408936: 2023-03-11 22:53:14,636 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1678575187642.39bbacab0d97c013b0afb55b77408936. 2023-03-11 22:53:14,636 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 22:53:14,636 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 22:53:14,636 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:14,636 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-03-11 22:53:14,636 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-03-11 22:53:14,638 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:14,638 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:14,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:14,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:53:14,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:53:14,638 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:14,638 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 22:53:14,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:53:14,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:53:14,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:14,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:14,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:53:14,640 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-03-11 22:53:14,640 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2a755bf9[Count = 0] remaining members to acquire global barrier 2023-03-11 22:53:14,640 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-03-11 22:53:14,640 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:14,641 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:14,641 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:14,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:14,641 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-03-11 22:53:14,641 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-03-11 22:53:14,641 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,41843,1678575183185' in zk 2023-03-11 22:53:14,641 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:14,641 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 22:53:14,642 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:14,642 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-03-11 22:53:14,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:14,642 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:53:14,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:53:14,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:53:14,642 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-03-11 22:53:14,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:53:14,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:53:14,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:14,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:14,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:53:14,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:14,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:14,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,41843,1678575183185': 2023-03-11 22:53:14,645 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-03-11 22:53:14,645 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-03-11 22:53:14,645 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 22:53:14,645 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 22:53:14,645 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:14,645 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 22:53:14,646 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:14,647 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:53:14,647 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:14,647 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:14,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:14,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:14,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:53:14,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:53:14,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:53:14,650 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:53:14,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:53:14,650 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:14,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:14,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:14,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:53:14,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:14,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:14,652 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:14,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:53:14,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:14,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:14,655 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:53:14,655 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:14,655 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:53:14,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:53:14,656 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-11 22:53:14,656 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 22:53:14,655 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:14,656 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:14,656 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:14,656 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:14,656 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:14,656 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:14,655 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:53:14,656 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:53:14,656 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-03-11 22:53:14,656 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 22:53:14,657 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:53:14,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:53:14,757 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 22:53:14,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 22:53:14,766 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-11 22:53:14,768 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-03-11 22:53:14,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:14,769 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-11 22:53:14,770 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:53:14,770 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-03-11 22:53:14,770 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-03-11 22:53:14,771 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:14,771 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:14,772 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:14,772 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:53:14,772 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:53:14,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:53:14,772 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:14,772 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 22:53:14,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:14,772 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:14,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 22:53:14,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:14,773 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:14,773 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-03-11 22:53:14,773 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:14,773 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-03-11 22:53:14,773 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:53:14,773 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-03-11 22:53:14,774 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 22:53:14,774 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 22:53:14,774 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1678575187642.39bbacab0d97c013b0afb55b77408936. 2023-03-11 22:53:14,774 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1678575187642.39bbacab0d97c013b0afb55b77408936. started... 2023-03-11 22:53:14,774 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 39bbacab0d97c013b0afb55b77408936 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-11 22:53:15,198 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907a7be638619624d049a6f3644f66f525c to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20150907a7be638619624d049a6f3644f66f525c 2023-03-11 22:53:15,609 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936/.tmp/family1/f23aaefe457c492e95aea7f4c804e46f 2023-03-11 22:53:15,623 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936/.tmp/family1/f23aaefe457c492e95aea7f4c804e46f as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936/family1/f23aaefe457c492e95aea7f4c804e46f 2023-03-11 22:53:15,633 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936/family1/f23aaefe457c492e95aea7f4c804e46f, entries=1, sequenceid=37, filesize=5.0 K 2023-03-11 22:53:15,634 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 39bbacab0d97c013b0afb55b77408936 in 860ms, sequenceid=37, compaction requested=true 2023-03-11 22:53:15,635 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 39bbacab0d97c013b0afb55b77408936: 2023-03-11 22:53:15,635 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1678575187642.39bbacab0d97c013b0afb55b77408936. 2023-03-11 22:53:15,635 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 22:53:15,635 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 22:53:15,635 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:15,635 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-03-11 22:53:15,636 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-03-11 22:53:15,637 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:15,637 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:15,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:15,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:53:15,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:53:15,637 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:15,637 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 22:53:15,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:53:15,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:53:15,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:15,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:15,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:53:15,639 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-03-11 22:53:15,639 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@19cc3bad[Count = 0] remaining members to acquire global barrier 2023-03-11 22:53:15,639 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-03-11 22:53:15,639 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:15,639 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:15,639 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:15,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:15,640 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-03-11 22:53:15,640 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:15,640 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-03-11 22:53:15,640 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 22:53:15,640 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,41843,1678575183185' in zk 2023-03-11 22:53:15,641 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-03-11 22:53:15,641 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:53:15,641 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-03-11 22:53:15,641 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:15,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:15,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:53:15,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:53:15,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:53:15,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:53:15,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:15,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:15,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:53:15,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:15,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:15,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,41843,1678575183185': 2023-03-11 22:53:15,649 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-03-11 22:53:15,649 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-03-11 22:53:15,649 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 22:53:15,649 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 22:53:15,649 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:15,649 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 22:53:15,655 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:15,655 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:15,655 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:15,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:15,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:53:15,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:53:15,655 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:53:15,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:15,656 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:15,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:53:15,656 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:53:15,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:53:15,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:15,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:15,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:53:15,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:15,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:15,659 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:15,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:53:15,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:15,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:15,664 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:53:15,664 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:53:15,664 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:53:15,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:53:15,664 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:15,664 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:15,664 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:15,664 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:15,664 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-11 22:53:15,664 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 22:53:15,664 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:53:15,664 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:15,665 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:53:15,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:53:15,666 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-03-11 22:53:15,666 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 22:53:15,665 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:15,666 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:15,766 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 22:53:15,768 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 22:53:15,781 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-11 22:53:15,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-03-11 22:53:15,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:15,795 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-11 22:53:15,795 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:53:15,796 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-03-11 22:53:15,796 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-03-11 22:53:15,797 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:15,797 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:15,798 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:53:15,798 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:15,798 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:53:15,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:53:15,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:15,800 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:15,800 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 22:53:15,800 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:15,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 22:53:15,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:15,801 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:15,807 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-03-11 22:53:15,808 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:15,808 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-03-11 22:53:15,808 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:53:15,809 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-03-11 22:53:15,810 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 22:53:15,810 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 22:53:15,810 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1678575187642.39bbacab0d97c013b0afb55b77408936. 2023-03-11 22:53:15,810 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1678575187642.39bbacab0d97c013b0afb55b77408936. started... 2023-03-11 22:53:15,811 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 39bbacab0d97c013b0afb55b77408936 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-11 22:53:15,875 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511206cbcb1e0a9264ee081b77938584b95a5 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511206cbcb1e0a9264ee081b77938584b95a5 2023-03-11 22:53:16,318 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936/.tmp/family1/1896d2c5b4614776811f17571af23692 2023-03-11 22:53:16,327 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936/.tmp/family1/1896d2c5b4614776811f17571af23692 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936/family1/1896d2c5b4614776811f17571af23692 2023-03-11 22:53:16,335 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936/family1/1896d2c5b4614776811f17571af23692, entries=1, sequenceid=41, filesize=5.0 K 2023-03-11 22:53:16,336 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 39bbacab0d97c013b0afb55b77408936 in 525ms, sequenceid=41, compaction requested=true 2023-03-11 22:53:16,336 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 39bbacab0d97c013b0afb55b77408936: 2023-03-11 22:53:16,336 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1678575187642.39bbacab0d97c013b0afb55b77408936. 2023-03-11 22:53:16,336 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 22:53:16,337 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 22:53:16,337 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:16,337 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-03-11 22:53:16,337 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-03-11 22:53:16,338 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:16,338 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:16,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:16,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:53:16,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:53:16,339 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:16,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:53:16,339 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 22:53:16,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:53:16,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:16,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:16,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:53:16,340 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-03-11 22:53:16,340 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1a876669[Count = 0] remaining members to acquire global barrier 2023-03-11 22:53:16,340 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-03-11 22:53:16,340 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:16,344 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:16,344 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 22:53:16,346 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:16,346 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:16,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:16,346 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-03-11 22:53:16,346 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-03-11 22:53:16,346 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,41843,1678575183185' in zk 2023-03-11 22:53:16,347 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-03-11 22:53:16,347 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:53:16,347 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-03-11 22:53:16,349 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:16,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:16,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:53:16,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:53:16,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:53:16,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:53:16,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:16,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:16,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:53:16,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:16,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:16,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,41843,1678575183185': 2023-03-11 22:53:16,352 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-03-11 22:53:16,352 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-03-11 22:53:16,352 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 22:53:16,352 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 22:53:16,352 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:16,352 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 22:53:16,353 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:16,353 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:53:16,353 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:16,353 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:16,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:16,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:53:16,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:53:16,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:16,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:53:16,354 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:53:16,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:53:16,354 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:16,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:16,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:16,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:53:16,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:16,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:16,356 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:16,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:53:16,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:16,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:16,358 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:16,358 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:53:16,358 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:53:16,358 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:53:16,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:53:16,358 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:16,359 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-11 22:53:16,359 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 22:53:16,358 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:53:16,359 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:53:16,359 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:16,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:53:16,359 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:16,359 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:16,359 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:16,359 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:16,359 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-03-11 22:53:16,359 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 22:53:16,460 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 22:53:16,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 22:53:16,468 DEBUG [Listener at localhost.localdomain/41563] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-03-11 22:53:16,470 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:49716, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-03-11 22:53:16,472 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=44347] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:16,486 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-03-11 22:53:16,487 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=12, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-03-11 22:53:16,489 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-11 22:53:16,489 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=12, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1678575796489 2023-03-11 22:53:16,491 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-11 22:53:16,496 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthly' and column 'family1' 2023-03-11 22:53:16,496 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-03-11 22:53:16,497 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] zookeeper.ReadOnlyZKClient(139): Connect 0x7fef5580 to 127.0.0.1:51815 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-11 22:53:16,505 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@124c7df, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-11 22:53:16,507 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-11 22:53:17,416 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103d473a8ae8e504e39956925c46819c186 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160103d473a8ae8e504e39956925c46819c186 2023-03-11 22:53:17,418 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-03-11 22:53:17,444 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-11 22:53:17,446 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:54130, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-11 22:53:17,461 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-11 22:53:17,463 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:49718, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-11 22:53:17,511 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/67c00e8adf9e406884c6f56a4e181215 first=Optional[r3] last=Optional[r6] 2023-03-11 22:53:17,525 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1678575187642.39bbacab0d97c013b0afb55b77408936., hostname=jenkins-hbase20.apache.org,41843,1678575183185, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/67c00e8adf9e406884c6f56a4e181215}] 2023-03-11 22:53:17,545 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/67c00e8adf9e406884c6f56a4e181215 for inclusion in 39bbacab0d97c013b0afb55b77408936/family1 2023-03-11 22:53:17,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-03-11 22:53:17,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(777): Region bounds: first= last= 2023-03-11 22:53:17,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HRegion(2446): Flush status journal for 39bbacab0d97c013b0afb55b77408936: 2023-03-11 22:53:17,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/67c00e8adf9e406884c6f56a4e181215 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__kstl11g2brcut2a0nsbbgccpmd77e8e9iifr34h17hr93ht8g3q8nrhtdl6r9o4c/family1/67c00e8adf9e406884c6f56a4e181215 2023-03-11 22:53:17,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__kstl11g2brcut2a0nsbbgccpmd77e8e9iifr34h17hr93ht8g3q8nrhtdl6r9o4c/family1/67c00e8adf9e406884c6f56a4e181215 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936/family1/6700eee7f7c246f08e1682140bc0cb0a_SeqId_44_ 2023-03-11 22:53:17,561 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__kstl11g2brcut2a0nsbbgccpmd77e8e9iifr34h17hr93ht8g3q8nrhtdl6r9o4c/family1/67c00e8adf9e406884c6f56a4e181215 into 39bbacab0d97c013b0afb55b77408936/family1 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936/family1/6700eee7f7c246f08e1682140bc0cb0a_SeqId_44_ - updating store file list. 2023-03-11 22:53:17,568 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936/family1/6700eee7f7c246f08e1682140bc0cb0a_SeqId_44_ into 39bbacab0d97c013b0afb55b77408936/family1 2023-03-11 22:53:17,569 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__kstl11g2brcut2a0nsbbgccpmd77e8e9iifr34h17hr93ht8g3q8nrhtdl6r9o4c/family1/67c00e8adf9e406884c6f56a4e181215 into 39bbacab0d97c013b0afb55b77408936/family1 (new location: hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936/family1/6700eee7f7c246f08e1682140bc0cb0a_SeqId_44_) 2023-03-11 22:53:17,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__kstl11g2brcut2a0nsbbgccpmd77e8e9iifr34h17hr93ht8g3q8nrhtdl6r9o4c/family1/67c00e8adf9e406884c6f56a4e181215 2023-03-11 22:53:17,571 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-03-11 22:53:17,579 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51357 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-03-11 22:53:17,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(1912): 39bbacab0d97c013b0afb55b77408936/family1 is initiating minor compaction 2023-03-11 22:53:17,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@b031e0d; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-11 22:53:17,583 INFO [RS:0;jenkins-hbase20:41843-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 39bbacab0d97c013b0afb55b77408936/family1 in testMajorCompactionWithWeeklyFollowedByMonthly,,1678575187642.39bbacab0d97c013b0afb55b77408936. 2023-03-11 22:53:17,584 INFO [RS:0;jenkins-hbase20:41843-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936/family1/41815a2dddb34fbbbb69002227c8b47b, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936/family1/96e26c254f814d5fb69096ae1bdd8554, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936/family1/6829deea2fc7485e8cb9231eae54aeb3, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936/family1/c352d084933f49f7aedf34dc68f82da9, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936/family1/01ece4d1ba3042eaa3eea19493009a69, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936/family1/15659b8dd4f94daca92d8710e147449a, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936/family1/8d320fb73c5b4730b0734cafa33bd640, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936/family1/f23aaefe457c492e95aea7f4c804e46f, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936/family1/1896d2c5b4614776811f17571af23692, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936/family1/6700eee7f7c246f08e1682140bc0cb0a_SeqId_44_] into tmpdir=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936/.tmp, totalSize=50.2 K 2023-03-11 22:53:17,584 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] compactions.Compactor(207): Compacting 41815a2dddb34fbbbb69002227c8b47b, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-03-11 22:53:17,584 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] compactions.Compactor(207): Compacting 96e26c254f814d5fb69096ae1bdd8554, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-03-11 22:53:17,584 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] compactions.Compactor(207): Compacting 6829deea2fc7485e8cb9231eae54aeb3, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-03-11 22:53:17,585 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] compactions.Compactor(207): Compacting c352d084933f49f7aedf34dc68f82da9, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-03-11 22:53:17,585 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] compactions.Compactor(207): Compacting 01ece4d1ba3042eaa3eea19493009a69, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-03-11 22:53:17,585 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] compactions.Compactor(207): Compacting 15659b8dd4f94daca92d8710e147449a, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-03-11 22:53:17,585 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] compactions.Compactor(207): Compacting 8d320fb73c5b4730b0734cafa33bd640, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-03-11 22:53:17,585 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] compactions.Compactor(207): Compacting f23aaefe457c492e95aea7f4c804e46f, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-03-11 22:53:17,585 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] compactions.Compactor(207): Compacting 1896d2c5b4614776811f17571af23692, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-03-11 22:53:17,585 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] compactions.Compactor(207): Compacting 6700eee7f7c246f08e1682140bc0cb0a_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-03-11 22:53:17,601 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-03-11 22:53:17,603 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 22:53:17,610 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015122866b7d73170404c67ba2ff4ef03a529ec to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015122866b7d73170404c67ba2ff4ef03a529ec 2023-03-11 22:53:17,612 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151231b5d732f256ba419eb308522b61c23c13 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151231b5d732f256ba419eb308522b61c23c13 2023-03-11 22:53:17,614 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201601015916ec9d430c4e58ad6860e0cf509114 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201601015916ec9d430c4e58ad6860e0cf509114 2023-03-11 22:53:17,616 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201601039300720214854da5bb6de1464d3da7ee to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201601039300720214854da5bb6de1464d3da7ee 2023-03-11 22:53:17,616 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 4 expired mob files are deleted 2023-03-11 22:53:17,616 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-03-11 22:53:17,617 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-11 22:53:17,617 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-11 22:53:17,617 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-11 22:53:17,617 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-11 22:53:17,617 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-11 22:53:17,618 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-11 22:53:17,618 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-11 22:53:17,618 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-11 22:53:17,676 INFO [RS:0;jenkins-hbase20:41843-shortCompactions-0] throttle.PressureAwareThroughputController(145): 39bbacab0d97c013b0afb55b77408936#family1#compaction#10 average throughput is 0.09 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-11 22:53:17,743 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936/.tmp/family1/3fc0813c019d4130bf24e87e03fc79e7 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936/family1/3fc0813c019d4130bf24e87e03fc79e7 2023-03-11 22:53:17,771 INFO [RS:0;jenkins-hbase20:41843-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 39bbacab0d97c013b0afb55b77408936/family1 of 39bbacab0d97c013b0afb55b77408936 into 3fc0813c019d4130bf24e87e03fc79e7(size=6.6 K), total size for store is 182.5 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-11 22:53:17,771 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 39bbacab0d97c013b0afb55b77408936: 2023-03-11 22:53:17,773 INFO [RS:0;jenkins-hbase20:41843-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthly,,1678575187642.39bbacab0d97c013b0afb55b77408936., storeName=family1, fileCount=10, fileSize=50.2 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.5 K), priority=2, time=1678575197580; duration=0sec 2023-03-11 22:53:17,779 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-11 22:53:17,788 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936/family1/41815a2dddb34fbbbb69002227c8b47b, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936/family1/96e26c254f814d5fb69096ae1bdd8554, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936/family1/6829deea2fc7485e8cb9231eae54aeb3, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936/family1/c352d084933f49f7aedf34dc68f82da9, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936/family1/01ece4d1ba3042eaa3eea19493009a69, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936/family1/15659b8dd4f94daca92d8710e147449a, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936/family1/8d320fb73c5b4730b0734cafa33bd640, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936/family1/f23aaefe457c492e95aea7f4c804e46f, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936/family1/1896d2c5b4614776811f17571af23692, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936/family1/6700eee7f7c246f08e1682140bc0cb0a_SeqId_44_] to archive 2023-03-11 22:53:17,789 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 22:53:17,792 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936/family1/41815a2dddb34fbbbb69002227c8b47b to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936/family1/41815a2dddb34fbbbb69002227c8b47b 2023-03-11 22:53:17,794 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936/family1/96e26c254f814d5fb69096ae1bdd8554 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936/family1/96e26c254f814d5fb69096ae1bdd8554 2023-03-11 22:53:17,796 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936/family1/6829deea2fc7485e8cb9231eae54aeb3 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936/family1/6829deea2fc7485e8cb9231eae54aeb3 2023-03-11 22:53:17,797 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936/family1/c352d084933f49f7aedf34dc68f82da9 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936/family1/c352d084933f49f7aedf34dc68f82da9 2023-03-11 22:53:17,799 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936/family1/01ece4d1ba3042eaa3eea19493009a69 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936/family1/01ece4d1ba3042eaa3eea19493009a69 2023-03-11 22:53:17,800 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936/family1/15659b8dd4f94daca92d8710e147449a to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936/family1/15659b8dd4f94daca92d8710e147449a 2023-03-11 22:53:17,802 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936/family1/8d320fb73c5b4730b0734cafa33bd640 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936/family1/8d320fb73c5b4730b0734cafa33bd640 2023-03-11 22:53:17,805 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936/family1/f23aaefe457c492e95aea7f4c804e46f to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936/family1/f23aaefe457c492e95aea7f4c804e46f 2023-03-11 22:53:17,806 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936/family1/1896d2c5b4614776811f17571af23692 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936/family1/1896d2c5b4614776811f17571af23692 2023-03-11 22:53:17,808 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936/family1/6700eee7f7c246f08e1682140bc0cb0a_SeqId_44_ to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936/family1/6700eee7f7c246f08e1682140bc0cb0a_SeqId_44_ 2023-03-11 22:53:18,604 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205fb3bf45aa3c74726b0821f9c787fb41e to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205fb3bf45aa3c74726b0821f9c787fb41e 2023-03-11 22:53:18,607 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-03-11 22:53:18,643 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/39b6f2c36dbc46f4957a5e064f3727a4 first=Optional[r00] last=Optional[r2] 2023-03-11 22:53:18,644 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1678575187642.39bbacab0d97c013b0afb55b77408936., hostname=jenkins-hbase20.apache.org,41843,1678575183185, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/39b6f2c36dbc46f4957a5e064f3727a4}] 2023-03-11 22:53:18,647 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/39b6f2c36dbc46f4957a5e064f3727a4 for inclusion in 39bbacab0d97c013b0afb55b77408936/family1 2023-03-11 22:53:18,652 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-03-11 22:53:18,652 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(777): Region bounds: first= last= 2023-03-11 22:53:18,652 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HRegion(2446): Flush status journal for 39bbacab0d97c013b0afb55b77408936: 2023-03-11 22:53:18,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/39b6f2c36dbc46f4957a5e064f3727a4 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__fvk1fvp9vm2961u2vieejukkb6r3ep95t7pogmh34srv7pamp2nvpumkajb76346/family1/39b6f2c36dbc46f4957a5e064f3727a4 2023-03-11 22:53:18,656 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__fvk1fvp9vm2961u2vieejukkb6r3ep95t7pogmh34srv7pamp2nvpumkajb76346/family1/39b6f2c36dbc46f4957a5e064f3727a4 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936/family1/8ab0bb321622498aba7f03ed797efa16_SeqId_47_ 2023-03-11 22:53:18,657 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__fvk1fvp9vm2961u2vieejukkb6r3ep95t7pogmh34srv7pamp2nvpumkajb76346/family1/39b6f2c36dbc46f4957a5e064f3727a4 into 39bbacab0d97c013b0afb55b77408936/family1 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936/family1/8ab0bb321622498aba7f03ed797efa16_SeqId_47_ - updating store file list. 2023-03-11 22:53:18,664 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936/family1/8ab0bb321622498aba7f03ed797efa16_SeqId_47_ into 39bbacab0d97c013b0afb55b77408936/family1 2023-03-11 22:53:18,664 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__fvk1fvp9vm2961u2vieejukkb6r3ep95t7pogmh34srv7pamp2nvpumkajb76346/family1/39b6f2c36dbc46f4957a5e064f3727a4 into 39bbacab0d97c013b0afb55b77408936/family1 (new location: hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936/family1/8ab0bb321622498aba7f03ed797efa16_SeqId_47_) 2023-03-11 22:53:18,664 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__fvk1fvp9vm2961u2vieejukkb6r3ep95t7pogmh34srv7pamp2nvpumkajb76346/family1/39b6f2c36dbc46f4957a5e064f3727a4 2023-03-11 22:53:18,664 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-03-11 22:53:18,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 367249 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-03-11 22:53:18,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(1912): 39bbacab0d97c013b0afb55b77408936/family1 is initiating minor compaction (all files) 2023-03-11 22:53:18,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@4e685531; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-11 22:53:18,666 INFO [RS:0;jenkins-hbase20:41843-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 39bbacab0d97c013b0afb55b77408936/family1 in testMajorCompactionWithWeeklyFollowedByMonthly,,1678575187642.39bbacab0d97c013b0afb55b77408936. 2023-03-11 22:53:18,667 INFO [RS:0;jenkins-hbase20:41843-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936/family1/1c16d93822694093805eb7788ffc250a, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936/family1/3fc0813c019d4130bf24e87e03fc79e7, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936/family1/8ab0bb321622498aba7f03ed797efa16_SeqId_47_] into tmpdir=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936/.tmp, totalSize=358.6 K 2023-03-11 22:53:18,668 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] compactions.Compactor(207): Compacting 1c16d93822694093805eb7788ffc250a, keycount=1000, bloomtype=ROW, size=175.8 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878807597 2023-03-11 22:53:18,668 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] compactions.Compactor(207): Compacting 3fc0813c019d4130bf24e87e03fc79e7, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621207597 2023-03-11 22:53:18,669 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] compactions.Compactor(207): Compacting 8ab0bb321622498aba7f03ed797efa16_SeqId_47_, keycount=1002, bloomtype=ROW, size=176.2 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878807597 2023-03-11 22:53:18,669 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-03-11 22:53:18,671 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 22:53:18,673 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511305e8853c51e0443dda2ca1d9db5f05b0d to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511305e8853c51e0443dda2ca1d9db5f05b0d 2023-03-11 22:53:18,675 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512010286ab3a58dc49f1bd20ee71b2363700 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512010286ab3a58dc49f1bd20ee71b2363700 2023-03-11 22:53:18,677 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205ffde72c4ec41459782727c791340348a to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205ffde72c4ec41459782727c791340348a 2023-03-11 22:53:18,677 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 3 expired mob files are deleted 2023-03-11 22:53:18,677 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-03-11 22:53:18,678 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-11 22:53:18,678 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-03-11 22:53:18,679 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-11 22:53:18,680 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=12, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-03-11 22:53:18,682 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE in 2.2020 sec 2023-03-11 22:53:18,722 INFO [RS:0;jenkins-hbase20:41843-shortCompactions-0] throttle.PressureAwareThroughputController(145): 39bbacab0d97c013b0afb55b77408936#family1#compaction#11 average throughput is 4.47 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-11 22:53:18,861 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.HMaster$12(2454): Client=jenkins//148.251.75.209 modify table testMajorCompactionWithWeeklyFollowedByMonthly from 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-03-11 22:53:18,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:19,289 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000002 2023-03-11 22:53:19,290 DEBUG [PEWorker-1] util.FSTableDescriptors(519): Deleted hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000001 2023-03-11 22:53:19,290 INFO [PEWorker-1] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000002 2023-03-11 22:53:19,295 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=14, ppid=13, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly}] 2023-03-11 22:53:19,312 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=39bbacab0d97c013b0afb55b77408936, REOPEN/MOVE}] 2023-03-11 22:53:19,313 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=39bbacab0d97c013b0afb55b77408936, REOPEN/MOVE 2023-03-11 22:53:19,314 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=39bbacab0d97c013b0afb55b77408936, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:19,315 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1678575187642.39bbacab0d97c013b0afb55b77408936.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1678575199314"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1678575199314"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678575199314"}]},"ts":"1678575199314"} 2023-03-11 22:53:19,318 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE; CloseRegionProcedure 39bbacab0d97c013b0afb55b77408936, server=jenkins-hbase20.apache.org,41843,1678575183185}] 2023-03-11 22:53:19,479 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close 39bbacab0d97c013b0afb55b77408936 2023-03-11 22:53:19,479 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 39bbacab0d97c013b0afb55b77408936, disabling compactions & flushes 2023-03-11 22:53:19,479 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1858): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthly,,1678575187642.39bbacab0d97c013b0afb55b77408936. 2023-03-11 22:53:19,563 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936/.tmp/family1/b2de235c1b564701b644758c18c21cc5 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936/family1/b2de235c1b564701b644758c18c21cc5 2023-03-11 22:53:19,572 INFO [RS:0;jenkins-hbase20:41843-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 39bbacab0d97c013b0afb55b77408936/family1 of 39bbacab0d97c013b0afb55b77408936 into b2de235c1b564701b644758c18c21cc5(size=177.2 K), total size for store is 177.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-11 22:53:19,572 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 39bbacab0d97c013b0afb55b77408936: 2023-03-11 22:53:19,572 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1678575187642.39bbacab0d97c013b0afb55b77408936. 2023-03-11 22:53:19,572 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1678575187642.39bbacab0d97c013b0afb55b77408936. 2023-03-11 22:53:19,572 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1678575187642.39bbacab0d97c013b0afb55b77408936. after waiting 0 ms 2023-03-11 22:53:19,572 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1678575187642.39bbacab0d97c013b0afb55b77408936. 2023-03-11 22:53:19,573 INFO [RS:0;jenkins-hbase20:41843-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthly,,1678575187642.39bbacab0d97c013b0afb55b77408936., storeName=family1, fileCount=3, fileSize=358.6 K (175.8 K, 6.6 K, 176.2 K), priority=2, time=1678575198666; duration=0sec 2023-03-11 22:53:19,574 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1678575187642.39bbacab0d97c013b0afb55b77408936.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936/family1/1c16d93822694093805eb7788ffc250a, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936/family1/3fc0813c019d4130bf24e87e03fc79e7, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936/family1/8ab0bb321622498aba7f03ed797efa16_SeqId_47_] to archive 2023-03-11 22:53:19,574 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-11 22:53:19,576 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1678575187642.39bbacab0d97c013b0afb55b77408936.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 22:53:19,581 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1678575187642.39bbacab0d97c013b0afb55b77408936.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936/family1/1c16d93822694093805eb7788ffc250a to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936/family1/1c16d93822694093805eb7788ffc250a 2023-03-11 22:53:19,584 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1678575187642.39bbacab0d97c013b0afb55b77408936.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936/family1/3fc0813c019d4130bf24e87e03fc79e7 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936/family1/3fc0813c019d4130bf24e87e03fc79e7 2023-03-11 22:53:19,589 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1678575187642.39bbacab0d97c013b0afb55b77408936.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936/family1/8ab0bb321622498aba7f03ed797efa16_SeqId_47_ to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936/family1/8ab0bb321622498aba7f03ed797efa16_SeqId_47_ 2023-03-11 22:53:19,602 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-03-11 22:53:19,604 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1678575187642.39bbacab0d97c013b0afb55b77408936. 2023-03-11 22:53:19,604 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 39bbacab0d97c013b0afb55b77408936: 2023-03-11 22:53:19,604 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(3509): Not adding moved region record: 39bbacab0d97c013b0afb55b77408936 to self. 2023-03-11 22:53:19,607 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed 39bbacab0d97c013b0afb55b77408936 2023-03-11 22:53:19,608 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=39bbacab0d97c013b0afb55b77408936, regionState=CLOSED 2023-03-11 22:53:19,608 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1678575187642.39bbacab0d97c013b0afb55b77408936.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1678575199608"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678575199608"}]},"ts":"1678575199608"} 2023-03-11 22:53:19,614 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-03-11 22:53:19,614 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; CloseRegionProcedure 39bbacab0d97c013b0afb55b77408936, server=jenkins-hbase20.apache.org,41843,1678575183185 in 292 msec 2023-03-11 22:53:19,615 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=39bbacab0d97c013b0afb55b77408936, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase20.apache.org,41843,1678575183185; forceNewPlan=false, retain=true 2023-03-11 22:53:19,766 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=39bbacab0d97c013b0afb55b77408936, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:19,767 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1678575187642.39bbacab0d97c013b0afb55b77408936.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1678575199766"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1678575199766"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678575199766"}]},"ts":"1678575199766"} 2023-03-11 22:53:19,774 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=15, state=RUNNABLE; OpenRegionProcedure 39bbacab0d97c013b0afb55b77408936, server=jenkins-hbase20.apache.org,41843,1678575183185}] 2023-03-11 22:53:19,931 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthly,,1678575187642.39bbacab0d97c013b0afb55b77408936. 2023-03-11 22:53:19,931 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 39bbacab0d97c013b0afb55b77408936, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1678575187642.39bbacab0d97c013b0afb55b77408936.', STARTKEY => '', ENDKEY => ''} 2023-03-11 22:53:19,932 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthly 39bbacab0d97c013b0afb55b77408936 2023-03-11 22:53:19,932 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1678575187642.39bbacab0d97c013b0afb55b77408936.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-11 22:53:19,932 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 39bbacab0d97c013b0afb55b77408936 2023-03-11 22:53:19,932 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 39bbacab0d97c013b0afb55b77408936 2023-03-11 22:53:19,933 INFO [StoreOpener-39bbacab0d97c013b0afb55b77408936-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 39bbacab0d97c013b0afb55b77408936 2023-03-11 22:53:19,935 DEBUG [StoreOpener-39bbacab0d97c013b0afb55b77408936-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936/family1 2023-03-11 22:53:19,935 DEBUG [StoreOpener-39bbacab0d97c013b0afb55b77408936-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936/family1 2023-03-11 22:53:19,935 INFO [StoreOpener-39bbacab0d97c013b0afb55b77408936-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 39bbacab0d97c013b0afb55b77408936 columnFamilyName family1 2023-03-11 22:53:19,943 DEBUG [StoreOpener-39bbacab0d97c013b0afb55b77408936-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936/family1/b2de235c1b564701b644758c18c21cc5 2023-03-11 22:53:19,944 INFO [StoreOpener-39bbacab0d97c013b0afb55b77408936-1] regionserver.HStore(310): Store=39bbacab0d97c013b0afb55b77408936/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-11 22:53:19,945 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936 2023-03-11 22:53:19,947 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936 2023-03-11 22:53:19,952 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 39bbacab0d97c013b0afb55b77408936 2023-03-11 22:53:19,953 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 39bbacab0d97c013b0afb55b77408936; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71446646, jitterRate=0.06463798880577087}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-11 22:53:19,953 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 39bbacab0d97c013b0afb55b77408936: 2023-03-11 22:53:19,954 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthly,,1678575187642.39bbacab0d97c013b0afb55b77408936., pid=17, masterSystemTime=1678575199927 2023-03-11 22:53:19,958 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthly,,1678575187642.39bbacab0d97c013b0afb55b77408936. 2023-03-11 22:53:19,958 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthly,,1678575187642.39bbacab0d97c013b0afb55b77408936. 2023-03-11 22:53:19,959 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=39bbacab0d97c013b0afb55b77408936, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:19,959 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1678575187642.39bbacab0d97c013b0afb55b77408936.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1678575199958"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1678575199958"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678575199958"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678575199958"}]},"ts":"1678575199958"} 2023-03-11 22:53:19,964 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=15 2023-03-11 22:53:19,964 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=15, state=SUCCESS; OpenRegionProcedure 39bbacab0d97c013b0afb55b77408936, server=jenkins-hbase20.apache.org,41843,1678575183185 in 187 msec 2023-03-11 22:53:19,967 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=14 2023-03-11 22:53:19,967 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=14, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=39bbacab0d97c013b0afb55b77408936, REOPEN/MOVE in 652 msec 2023-03-11 22:53:19,971 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=14, resume processing ppid=13 2023-03-11 22:53:19,971 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=13, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 674 msec 2023-03-11 22:53:19,974 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 1.1080 sec 2023-03-11 22:53:19,977 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1227): Checking to see if procedure is done pid=13 2023-03-11 22:53:19,986 INFO [Listener at localhost.localdomain/41563] compactions.TestMobCompactor(278): alter status finished 2023-03-11 22:53:19,987 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=44347] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-11 22:53:19,989 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-03-11 22:53:19,990 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-03-11 22:53:19,991 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-11 22:53:19,991 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1678575799991 2023-03-11 22:53:19,992 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-11 22:53:19,993 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthly' and column 'family1' 2023-03-11 22:53:19,993 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-03-11 22:53:19,994 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] zookeeper.ReadOnlyZKClient(139): Connect 0x71d12e1b to 127.0.0.1:51815 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-11 22:53:20,005 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@515eb251, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-11 22:53:20,005 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-11 22:53:20,005 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-11 22:53:20,005 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-11 22:53:20,006 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-11 22:53:20,006 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-11 22:53:20,850 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112824e870162f994bfea1410ab4aa3d6135 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015112824e870162f994bfea1410ab4aa3d6135 2023-03-11 22:53:20,851 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-03-11 22:53:20,862 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-11 22:53:20,863 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:41400, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-11 22:53:20,870 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-11 22:53:20,872 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:50450, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-11 22:53:20,882 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/7dfa53f74c614f148ae4017de2542fa5 first=Optional[r05] last=Optional[r8] 2023-03-11 22:53:20,883 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1678575187642.39bbacab0d97c013b0afb55b77408936., hostname=jenkins-hbase20.apache.org,41843,1678575183185, seqNum=51 for row with hfile group [{family1,hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/7dfa53f74c614f148ae4017de2542fa5}] 2023-03-11 22:53:20,888 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/7dfa53f74c614f148ae4017de2542fa5 for inclusion in 39bbacab0d97c013b0afb55b77408936/family1 2023-03-11 22:53:20,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-03-11 22:53:20,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(777): Region bounds: first= last= 2023-03-11 22:53:20,892 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HRegion(2446): Flush status journal for 39bbacab0d97c013b0afb55b77408936: 2023-03-11 22:53:20,893 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/7dfa53f74c614f148ae4017de2542fa5 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__nns2t7ccb2l422na7m9e49r6765j3sdu0j2qkpntp8v9l5cfi2tokv7qcqt6kgns/family1/7dfa53f74c614f148ae4017de2542fa5 2023-03-11 22:53:20,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__nns2t7ccb2l422na7m9e49r6765j3sdu0j2qkpntp8v9l5cfi2tokv7qcqt6kgns/family1/7dfa53f74c614f148ae4017de2542fa5 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936/family1/2839ca9d80134c779e518dd2a704efc4_SeqId_53_ 2023-03-11 22:53:20,896 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__nns2t7ccb2l422na7m9e49r6765j3sdu0j2qkpntp8v9l5cfi2tokv7qcqt6kgns/family1/7dfa53f74c614f148ae4017de2542fa5 into 39bbacab0d97c013b0afb55b77408936/family1 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936/family1/2839ca9d80134c779e518dd2a704efc4_SeqId_53_ - updating store file list. 2023-03-11 22:53:20,901 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936/family1/2839ca9d80134c779e518dd2a704efc4_SeqId_53_ into 39bbacab0d97c013b0afb55b77408936/family1 2023-03-11 22:53:20,901 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__nns2t7ccb2l422na7m9e49r6765j3sdu0j2qkpntp8v9l5cfi2tokv7qcqt6kgns/family1/7dfa53f74c614f148ae4017de2542fa5 into 39bbacab0d97c013b0afb55b77408936/family1 (new location: hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936/family1/2839ca9d80134c779e518dd2a704efc4_SeqId_53_) 2023-03-11 22:53:20,901 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__nns2t7ccb2l422na7m9e49r6765j3sdu0j2qkpntp8v9l5cfi2tokv7qcqt6kgns/family1/7dfa53f74c614f148ae4017de2542fa5 2023-03-11 22:53:20,903 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-03-11 22:53:20,904 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 22:53:20,906 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511206cbcb1e0a9264ee081b77938584b95a5 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511206cbcb1e0a9264ee081b77938584b95a5 2023-03-11 22:53:20,907 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511289b6fd981bedc4f0db38b204b3204f1d7 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511289b6fd981bedc4f0db38b204b3204f1d7 2023-03-11 22:53:20,907 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 2 expired mob files are deleted 2023-03-11 22:53:20,908 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-03-11 22:53:20,908 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-11 22:53:20,908 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-11 22:53:20,908 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-11 22:53:20,908 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-03-11 22:53:20,908 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-11 22:53:20,909 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-03-11 22:53:20,911 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE in 921 msec 2023-03-11 22:53:20,995 INFO [Listener at localhost.localdomain/41563] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthly Thread=246 (was 211) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:51815@0x7fef5580-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:51815@0x71d12e1b-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: hconnection-0x678d7c6d-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2108950010_15 at /127.0.0.1:39154 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2108950010_15 at /127.0.0.1:39054 [Waiting for operation #16] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:51815@0x7fef5580-SendThread(127.0.0.1:51815) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:51815@0x71d12e1b-SendThread(127.0.0.1:51815) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2108950010_15 at /127.0.0.1:39060 [Waiting for operation #22] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2108950010_15 at /127.0.0.1:39144 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x678d7c6d-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2108950010_15 at /127.0.0.1:39028 [Waiting for operation #16] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2108950010_15 at /127.0.0.1:39110 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobCompactor-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2108950010_15 at /127.0.0.1:38960 [Waiting for operation #13] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:51815@0x7fef5580 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$45/1628759669.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2108950010_15 at /127.0.0.1:38996 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2108950010_15 at /127.0.0.1:39012 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6bb91a02-shared-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6bb91a02-shared-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2108950010_15 at /127.0.0.1:39232 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS:0;jenkins-hbase20:41843-shortCompactions-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.PriorityBlockingQueue.take(PriorityBlockingQueue.java:549) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2108950010_15 at /127.0.0.1:39162 [Waiting for operation #12] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:51815@0x71d12e1b sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$45/1628759669.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hfile_cleaner-dir-scan-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hfile_cleaner-dir-scan-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_267214471_15 at /127.0.0.1:39038 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2108950010_15 at /127.0.0.1:39226 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2108950010_15 at /127.0.0.1:39134 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2108950010_15 at /127.0.0.1:39178 [Waiting for operation #17] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: RSProcedureDispatcher-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x678d7c6d-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=591 (was 475) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=379 (was 335) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=21895 (was 22251) 2023-03-11 22:53:21,007 INFO [Listener at localhost.localdomain/41563] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithMonthlyPolicy Thread=246, OpenFileDescriptor=591, MaxFileDescriptor=60000, SystemLoadAverage=379, ProcessCount=168, AvailableMemoryMB=21894 2023-03-11 22:53:21,010 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testMajorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-03-11 22:53:21,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:21,013 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-03-11 22:53:21,013 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(697): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithMonthlyPolicy" procId is: 19 2023-03-11 22:53:21,013 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-11 22:53:21,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-03-11 22:53:21,015 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/616fda1710f6e641a6e510cc06f7f66d 2023-03-11 22:53:21,016 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/616fda1710f6e641a6e510cc06f7f66d empty. 2023-03-11 22:53:21,016 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/616fda1710f6e641a6e510cc06f7f66d 2023-03-11 22:53:21,016 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithMonthlyPolicy regions 2023-03-11 22:53:21,029 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/.tabledesc/.tableinfo.0000000001 2023-03-11 22:53:21,031 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => 616fda1710f6e641a6e510cc06f7f66d, NAME => 'testMajorCompactionWithMonthlyPolicy,,1678575201009.616fda1710f6e641a6e510cc06f7f66d.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}, regionDir=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/.tmp 2023-03-11 22:53:21,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-03-11 22:53:21,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-03-11 22:53:21,439 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithMonthlyPolicy,,1678575201009.616fda1710f6e641a6e510cc06f7f66d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-11 22:53:21,439 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1604): Closing 616fda1710f6e641a6e510cc06f7f66d, disabling compactions & flushes 2023-03-11 22:53:21,439 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithMonthlyPolicy,,1678575201009.616fda1710f6e641a6e510cc06f7f66d. 2023-03-11 22:53:21,439 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithMonthlyPolicy,,1678575201009.616fda1710f6e641a6e510cc06f7f66d. 2023-03-11 22:53:21,439 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithMonthlyPolicy,,1678575201009.616fda1710f6e641a6e510cc06f7f66d. after waiting 0 ms 2023-03-11 22:53:21,439 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithMonthlyPolicy,,1678575201009.616fda1710f6e641a6e510cc06f7f66d. 2023-03-11 22:53:21,439 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithMonthlyPolicy,,1678575201009.616fda1710f6e641a6e510cc06f7f66d. 2023-03-11 22:53:21,439 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for 616fda1710f6e641a6e510cc06f7f66d: 2023-03-11 22:53:21,442 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-03-11 22:53:21,444 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithMonthlyPolicy,,1678575201009.616fda1710f6e641a6e510cc06f7f66d.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1678575201443"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678575201443"}]},"ts":"1678575201443"} 2023-03-11 22:53:21,446 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-03-11 22:53:21,447 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-11 22:53:21,447 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678575201447"}]},"ts":"1678575201447"} 2023-03-11 22:53:21,449 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithMonthlyPolicy, state=ENABLING in hbase:meta 2023-03-11 22:53:21,451 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=616fda1710f6e641a6e510cc06f7f66d, ASSIGN}] 2023-03-11 22:53:21,453 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=616fda1710f6e641a6e510cc06f7f66d, ASSIGN 2023-03-11 22:53:21,454 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=616fda1710f6e641a6e510cc06f7f66d, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,41843,1678575183185; forceNewPlan=false, retain=false 2023-03-11 22:53:21,605 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=616fda1710f6e641a6e510cc06f7f66d, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:21,606 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithMonthlyPolicy,,1678575201009.616fda1710f6e641a6e510cc06f7f66d.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1678575201605"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1678575201605"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678575201605"}]},"ts":"1678575201605"} 2023-03-11 22:53:21,608 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=20, state=RUNNABLE; OpenRegionProcedure 616fda1710f6e641a6e510cc06f7f66d, server=jenkins-hbase20.apache.org,41843,1678575183185}] 2023-03-11 22:53:21,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-03-11 22:53:21,764 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithMonthlyPolicy,,1678575201009.616fda1710f6e641a6e510cc06f7f66d. 2023-03-11 22:53:21,764 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 616fda1710f6e641a6e510cc06f7f66d, NAME => 'testMajorCompactionWithMonthlyPolicy,,1678575201009.616fda1710f6e641a6e510cc06f7f66d.', STARTKEY => '', ENDKEY => ''} 2023-03-11 22:53:21,764 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithMonthlyPolicy 616fda1710f6e641a6e510cc06f7f66d 2023-03-11 22:53:21,764 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithMonthlyPolicy,,1678575201009.616fda1710f6e641a6e510cc06f7f66d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-11 22:53:21,765 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 616fda1710f6e641a6e510cc06f7f66d 2023-03-11 22:53:21,765 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 616fda1710f6e641a6e510cc06f7f66d 2023-03-11 22:53:21,766 INFO [StoreOpener-616fda1710f6e641a6e510cc06f7f66d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 616fda1710f6e641a6e510cc06f7f66d 2023-03-11 22:53:21,768 DEBUG [StoreOpener-616fda1710f6e641a6e510cc06f7f66d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithMonthlyPolicy/616fda1710f6e641a6e510cc06f7f66d/family1 2023-03-11 22:53:21,768 DEBUG [StoreOpener-616fda1710f6e641a6e510cc06f7f66d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithMonthlyPolicy/616fda1710f6e641a6e510cc06f7f66d/family1 2023-03-11 22:53:21,769 INFO [StoreOpener-616fda1710f6e641a6e510cc06f7f66d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 616fda1710f6e641a6e510cc06f7f66d columnFamilyName family1 2023-03-11 22:53:21,771 INFO [StoreOpener-616fda1710f6e641a6e510cc06f7f66d-1] regionserver.HStore(310): Store=616fda1710f6e641a6e510cc06f7f66d/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-11 22:53:21,773 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithMonthlyPolicy/616fda1710f6e641a6e510cc06f7f66d 2023-03-11 22:53:21,773 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithMonthlyPolicy/616fda1710f6e641a6e510cc06f7f66d 2023-03-11 22:53:21,776 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 616fda1710f6e641a6e510cc06f7f66d 2023-03-11 22:53:21,778 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithMonthlyPolicy/616fda1710f6e641a6e510cc06f7f66d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-11 22:53:21,779 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 616fda1710f6e641a6e510cc06f7f66d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61386365, jitterRate=-0.08527188003063202}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-11 22:53:21,779 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 616fda1710f6e641a6e510cc06f7f66d: 2023-03-11 22:53:21,780 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithMonthlyPolicy,,1678575201009.616fda1710f6e641a6e510cc06f7f66d., pid=21, masterSystemTime=1678575201760 2023-03-11 22:53:21,783 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithMonthlyPolicy,,1678575201009.616fda1710f6e641a6e510cc06f7f66d. 2023-03-11 22:53:21,783 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithMonthlyPolicy,,1678575201009.616fda1710f6e641a6e510cc06f7f66d. 2023-03-11 22:53:21,784 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=616fda1710f6e641a6e510cc06f7f66d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:21,784 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithMonthlyPolicy,,1678575201009.616fda1710f6e641a6e510cc06f7f66d.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1678575201783"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1678575201783"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678575201783"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678575201783"}]},"ts":"1678575201783"} 2023-03-11 22:53:21,788 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=20 2023-03-11 22:53:21,788 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=20, state=SUCCESS; OpenRegionProcedure 616fda1710f6e641a6e510cc06f7f66d, server=jenkins-hbase20.apache.org,41843,1678575183185 in 178 msec 2023-03-11 22:53:21,791 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=20, resume processing ppid=19 2023-03-11 22:53:21,791 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=19, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=616fda1710f6e641a6e510cc06f7f66d, ASSIGN in 338 msec 2023-03-11 22:53:21,792 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-11 22:53:21,793 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678575201792"}]},"ts":"1678575201792"} 2023-03-11 22:53:21,794 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithMonthlyPolicy, state=ENABLED in hbase:meta 2023-03-11 22:53:21,797 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-03-11 22:53:21,799 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy in 787 msec 2023-03-11 22:53:22,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-03-11 22:53:22,119 INFO [Listener at localhost.localdomain/41563] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithMonthlyPolicy, procId: 19 completed 2023-03-11 22:53:22,165 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-11 22:53:22,170 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:22,170 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-03-11 22:53:22,170 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:53:22,171 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-11 22:53:22,171 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-11 22:53:22,176 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:22,176 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:22,177 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:22,177 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:53:22,178 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:53:22,178 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:22,178 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 22:53:22,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:53:22,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:22,178 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:22,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 22:53:22,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:22,179 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:22,179 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:22,179 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-11 22:53:22,179 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:53:22,180 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-11 22:53:22,180 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 22:53:22,180 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 22:53:22,180 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1678575201009.616fda1710f6e641a6e510cc06f7f66d. 2023-03-11 22:53:22,180 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1678575201009.616fda1710f6e641a6e510cc06f7f66d. started... 2023-03-11 22:53:22,181 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 616fda1710f6e641a6e510cc06f7f66d 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-03-11 22:53:22,232 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130f8228bc9a2eb4c7092b75f92c8ec9aaf to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151130f8228bc9a2eb4c7092b75f92c8ec9aaf 2023-03-11 22:53:22,238 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithMonthlyPolicy/616fda1710f6e641a6e510cc06f7f66d/.tmp/family1/c2fdb89c13714de58b0de51f46248d8a 2023-03-11 22:53:22,249 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithMonthlyPolicy/616fda1710f6e641a6e510cc06f7f66d/.tmp/family1/c2fdb89c13714de58b0de51f46248d8a as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithMonthlyPolicy/616fda1710f6e641a6e510cc06f7f66d/family1/c2fdb89c13714de58b0de51f46248d8a 2023-03-11 22:53:22,257 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithMonthlyPolicy/616fda1710f6e641a6e510cc06f7f66d/family1/c2fdb89c13714de58b0de51f46248d8a, entries=1000, sequenceid=5, filesize=166.0 K 2023-03-11 22:53:22,259 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 616fda1710f6e641a6e510cc06f7f66d in 78ms, sequenceid=5, compaction requested=false 2023-03-11 22:53:22,259 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithMonthlyPolicy' 2023-03-11 22:53:22,260 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 616fda1710f6e641a6e510cc06f7f66d: 2023-03-11 22:53:22,260 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1678575201009.616fda1710f6e641a6e510cc06f7f66d. 2023-03-11 22:53:22,260 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 22:53:22,260 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 22:53:22,260 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:22,260 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-03-11 22:53:22,260 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-03-11 22:53:22,262 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:22,262 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:22,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:22,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:53:22,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:53:22,262 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:22,262 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 22:53:22,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:53:22,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:53:22,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:22,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:22,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:53:22,264 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-03-11 22:53:22,264 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@45358565[Count = 0] remaining members to acquire global barrier 2023-03-11 22:53:22,264 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-11 22:53:22,264 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:22,264 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:22,264 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:22,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:22,265 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-11 22:53:22,265 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-03-11 22:53:22,265 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,41843,1678575183185' in zk 2023-03-11 22:53:22,265 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:22,265 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 22:53:22,266 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-11 22:53:22,266 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:53:22,266 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:22,266 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-03-11 22:53:22,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:22,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:53:22,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:53:22,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:53:22,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:53:22,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:22,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:22,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:53:22,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:22,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:22,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,41843,1678575183185': 2023-03-11 22:53:22,269 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-11 22:53:22,269 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-03-11 22:53:22,269 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 22:53:22,269 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 22:53:22,270 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:22,270 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 22:53:22,271 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:22,271 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:53:22,271 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:22,271 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:22,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:22,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:22,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:53:22,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:53:22,272 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:53:22,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:53:22,272 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:22,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:53:22,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:22,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:22,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:53:22,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:22,274 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:22,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:22,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:53:22,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:22,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:22,280 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:22,280 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:53:22,280 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:22,280 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:53:22,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:53:22,280 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:53:22,280 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-03-11 22:53:22,281 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 22:53:22,280 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:53:22,280 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:22,281 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:22,281 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:22,281 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:22,282 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:22,282 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-11 22:53:22,282 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-11 22:53:22,282 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 22:53:22,282 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:53:22,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:53:22,382 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 22:53:22,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 22:53:22,389 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-11 22:53:22,396 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-11 22:53:22,396 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:22,396 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-03-11 22:53:22,396 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:53:22,397 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-11 22:53:22,397 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-11 22:53:22,398 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:22,398 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:22,399 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:53:22,399 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:22,399 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:53:22,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:53:22,399 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:22,399 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 22:53:22,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:22,400 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:22,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 22:53:22,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:22,400 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:22,406 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-03-11 22:53:22,406 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:22,406 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-11 22:53:22,406 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:53:22,407 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-11 22:53:22,407 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 22:53:22,407 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 22:53:22,407 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1678575201009.616fda1710f6e641a6e510cc06f7f66d. 2023-03-11 22:53:22,407 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1678575201009.616fda1710f6e641a6e510cc06f7f66d. started... 2023-03-11 22:53:22,407 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 616fda1710f6e641a6e510cc06f7f66d 1/1 column families, dataSize=74 B heapSize=408 B 2023-03-11 22:53:22,429 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511288eb085a4c1d04457a8a75b09eb887e79 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511288eb085a4c1d04457a8a75b09eb887e79 2023-03-11 22:53:22,835 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithMonthlyPolicy/616fda1710f6e641a6e510cc06f7f66d/.tmp/family1/58524c7393d04ba1985d505068b4d867 2023-03-11 22:53:22,842 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithMonthlyPolicy/616fda1710f6e641a6e510cc06f7f66d/.tmp/family1/58524c7393d04ba1985d505068b4d867 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithMonthlyPolicy/616fda1710f6e641a6e510cc06f7f66d/family1/58524c7393d04ba1985d505068b4d867 2023-03-11 22:53:22,849 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithMonthlyPolicy/616fda1710f6e641a6e510cc06f7f66d/family1/58524c7393d04ba1985d505068b4d867, entries=1, sequenceid=9, filesize=5.0 K 2023-03-11 22:53:22,850 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 616fda1710f6e641a6e510cc06f7f66d in 443ms, sequenceid=9, compaction requested=false 2023-03-11 22:53:22,850 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 616fda1710f6e641a6e510cc06f7f66d: 2023-03-11 22:53:22,850 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1678575201009.616fda1710f6e641a6e510cc06f7f66d. 2023-03-11 22:53:22,850 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 22:53:22,850 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 22:53:22,850 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:22,850 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-03-11 22:53:22,850 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-03-11 22:53:22,851 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:22,851 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:22,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:22,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:53:22,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:53:22,852 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:22,852 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 22:53:22,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:53:22,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:53:22,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:22,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:22,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:53:22,853 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-03-11 22:53:22,853 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@459fa4a9[Count = 0] remaining members to acquire global barrier 2023-03-11 22:53:22,853 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-11 22:53:22,853 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:22,854 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:22,854 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:22,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:22,854 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-11 22:53:22,854 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-03-11 22:53:22,854 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:22,854 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 22:53:22,854 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,41843,1678575183185' in zk 2023-03-11 22:53:22,855 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:22,855 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-11 22:53:22,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:22,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:53:22,855 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:53:22,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:53:22,855 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-03-11 22:53:22,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:53:22,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:53:22,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:22,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:22,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:53:22,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:22,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:22,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,41843,1678575183185': 2023-03-11 22:53:22,858 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-11 22:53:22,858 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-03-11 22:53:22,858 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 22:53:22,858 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 22:53:22,858 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:22,858 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 22:53:22,859 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:22,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:22,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:53:22,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:53:22,859 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:22,859 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:53:22,859 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:22,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:22,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:53:22,860 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:22,860 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:53:22,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:53:22,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:22,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:22,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:53:22,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:22,861 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:22,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:22,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:53:22,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:22,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:22,864 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:22,864 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:53:22,864 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:22,864 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:53:22,864 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:53:22,864 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:53:22,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:53:22,864 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-03-11 22:53:22,865 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 22:53:22,864 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:22,865 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:22,865 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:22,865 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:22,865 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:22,865 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:53:22,865 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-11 22:53:22,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:53:22,866 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 22:53:22,966 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 22:53:22,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 22:53:22,971 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-11 22:53:22,973 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-11 22:53:22,973 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:22,973 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-03-11 22:53:22,973 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:53:22,974 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-11 22:53:22,974 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-11 22:53:22,975 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:22,975 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:22,976 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:53:22,976 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:22,976 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:53:22,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:53:22,976 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:22,976 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 22:53:22,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:22,977 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:22,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 22:53:22,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:22,977 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:22,977 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-03-11 22:53:22,977 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:22,977 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-11 22:53:22,977 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:53:22,978 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-11 22:53:22,978 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 22:53:22,978 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 22:53:22,978 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1678575201009.616fda1710f6e641a6e510cc06f7f66d. 2023-03-11 22:53:22,978 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1678575201009.616fda1710f6e641a6e510cc06f7f66d. started... 2023-03-11 22:53:22,978 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 616fda1710f6e641a6e510cc06f7f66d 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-11 22:53:23,395 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201d8e68acdcee443e2951e53be064eff32 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151201d8e68acdcee443e2951e53be064eff32 2023-03-11 22:53:23,802 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithMonthlyPolicy/616fda1710f6e641a6e510cc06f7f66d/.tmp/family1/bf41caa7e74a4f88bbd3d31436eadf9e 2023-03-11 22:53:23,822 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithMonthlyPolicy/616fda1710f6e641a6e510cc06f7f66d/.tmp/family1/bf41caa7e74a4f88bbd3d31436eadf9e as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithMonthlyPolicy/616fda1710f6e641a6e510cc06f7f66d/family1/bf41caa7e74a4f88bbd3d31436eadf9e 2023-03-11 22:53:23,830 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithMonthlyPolicy/616fda1710f6e641a6e510cc06f7f66d/family1/bf41caa7e74a4f88bbd3d31436eadf9e, entries=1, sequenceid=13, filesize=4.9 K 2023-03-11 22:53:23,831 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 616fda1710f6e641a6e510cc06f7f66d in 853ms, sequenceid=13, compaction requested=true 2023-03-11 22:53:23,832 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 616fda1710f6e641a6e510cc06f7f66d: 2023-03-11 22:53:23,832 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1678575201009.616fda1710f6e641a6e510cc06f7f66d. 2023-03-11 22:53:23,832 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 22:53:23,832 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 22:53:23,832 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:23,832 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-03-11 22:53:23,832 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-03-11 22:53:23,833 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:23,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:23,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:53:23,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:53:23,834 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:23,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:53:23,834 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:23,834 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 22:53:23,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:53:23,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:23,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:23,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:53:23,835 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-03-11 22:53:23,835 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3df6fee4[Count = 0] remaining members to acquire global barrier 2023-03-11 22:53:23,835 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-11 22:53:23,835 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:23,836 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:23,836 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:23,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:23,836 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-11 22:53:23,836 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-03-11 22:53:23,836 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:23,836 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 22:53:23,836 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,41843,1678575183185' in zk 2023-03-11 22:53:23,837 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:23,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:23,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:53:23,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:53:23,838 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-11 22:53:23,838 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:53:23,838 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-03-11 22:53:23,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:53:23,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:53:23,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:23,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:23,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:53:23,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:23,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:23,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,41843,1678575183185': 2023-03-11 22:53:23,841 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-11 22:53:23,841 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-03-11 22:53:23,841 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 22:53:23,841 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 22:53:23,841 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:23,841 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 22:53:23,847 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:23,847 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:23,847 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:23,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:23,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:53:23,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:53:23,847 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:53:23,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:23,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:53:23,847 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:53:23,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:53:23,848 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:23,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:23,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:23,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:53:23,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:23,852 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:23,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:23,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:53:23,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:23,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:23,856 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:23,856 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:53:23,856 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:53:23,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:53:23,856 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:53:23,856 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:23,856 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:23,856 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:23,856 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:23,857 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:23,857 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:23,856 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:53:23,856 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-03-11 22:53:23,857 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 22:53:23,857 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:53:23,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:53:23,857 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-11 22:53:23,858 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 22:53:23,858 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-11 22:53:23,958 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 22:53:23,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 22:53:23,966 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-11 22:53:23,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-11 22:53:23,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:23,969 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-03-11 22:53:23,970 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:53:23,970 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-11 22:53:23,971 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-11 22:53:23,971 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:23,971 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:23,972 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:53:23,972 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:23,972 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:53:23,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:53:23,973 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:23,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:23,973 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 22:53:23,973 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:23,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 22:53:23,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:23,973 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:23,974 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-03-11 22:53:23,974 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:23,974 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-11 22:53:23,974 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:53:23,975 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-11 22:53:23,975 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 22:53:23,975 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 22:53:23,975 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1678575201009.616fda1710f6e641a6e510cc06f7f66d. 2023-03-11 22:53:23,975 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1678575201009.616fda1710f6e641a6e510cc06f7f66d. started... 2023-03-11 22:53:23,975 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 616fda1710f6e641a6e510cc06f7f66d 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-11 22:53:24,012 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120501ee27a4f7284a7ebcf377713e32cf8d to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015120501ee27a4f7284a7ebcf377713e32cf8d 2023-03-11 22:53:24,423 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithMonthlyPolicy/616fda1710f6e641a6e510cc06f7f66d/.tmp/family1/57bdd2d26b29461ca9abe93bfd1c399c 2023-03-11 22:53:24,431 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithMonthlyPolicy/616fda1710f6e641a6e510cc06f7f66d/.tmp/family1/57bdd2d26b29461ca9abe93bfd1c399c as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithMonthlyPolicy/616fda1710f6e641a6e510cc06f7f66d/family1/57bdd2d26b29461ca9abe93bfd1c399c 2023-03-11 22:53:24,438 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithMonthlyPolicy/616fda1710f6e641a6e510cc06f7f66d/family1/57bdd2d26b29461ca9abe93bfd1c399c, entries=1, sequenceid=17, filesize=4.9 K 2023-03-11 22:53:24,439 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 616fda1710f6e641a6e510cc06f7f66d in 464ms, sequenceid=17, compaction requested=true 2023-03-11 22:53:24,439 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 616fda1710f6e641a6e510cc06f7f66d: 2023-03-11 22:53:24,439 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1678575201009.616fda1710f6e641a6e510cc06f7f66d. 2023-03-11 22:53:24,439 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 22:53:24,440 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 22:53:24,440 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:24,440 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-03-11 22:53:24,440 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-03-11 22:53:24,441 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:24,441 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:24,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:24,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:53:24,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:53:24,441 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:24,441 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 22:53:24,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:53:24,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:53:24,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:24,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:24,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:53:24,443 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-03-11 22:53:24,443 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1c63731d[Count = 0] remaining members to acquire global barrier 2023-03-11 22:53:24,443 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-11 22:53:24,443 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:24,444 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:24,444 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 22:53:24,445 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:24,445 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:24,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:24,445 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-11 22:53:24,445 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-03-11 22:53:24,445 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,41843,1678575183185' in zk 2023-03-11 22:53:24,446 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-11 22:53:24,446 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:24,446 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:53:24,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:24,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:53:24,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:53:24,446 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-03-11 22:53:24,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:53:24,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:53:24,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:24,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:24,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:53:24,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:24,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:24,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,41843,1678575183185': 2023-03-11 22:53:24,449 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-11 22:53:24,449 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-03-11 22:53:24,449 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 22:53:24,449 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 22:53:24,449 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:24,449 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 22:53:24,455 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:24,455 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:24,455 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:24,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:24,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:53:24,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:53:24,455 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:53:24,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:24,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:53:24,456 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:24,456 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:53:24,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:53:24,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:24,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:24,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:53:24,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:24,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:24,458 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:24,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:53:24,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:24,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:24,463 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:53:24,463 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:24,463 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:53:24,463 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:53:24,464 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-03-11 22:53:24,464 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 22:53:24,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:53:24,464 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:53:24,463 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:24,465 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:24,465 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:24,465 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:24,465 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-11 22:53:24,465 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:24,465 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 22:53:24,465 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:24,466 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:53:24,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:53:24,565 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 22:53:24,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 22:53:24,573 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-11 22:53:24,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-11 22:53:24,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:24,575 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-03-11 22:53:24,575 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:53:24,577 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-11 22:53:24,577 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-11 22:53:24,577 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:24,577 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:24,578 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:24,578 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:53:24,578 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:53:24,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:53:24,579 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:24,579 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 22:53:24,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:24,579 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:24,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 22:53:24,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:24,579 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:24,580 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-03-11 22:53:24,580 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:24,580 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-11 22:53:24,580 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:53:24,581 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-11 22:53:24,581 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 22:53:24,581 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 22:53:24,581 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1678575201009.616fda1710f6e641a6e510cc06f7f66d. 2023-03-11 22:53:24,581 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1678575201009.616fda1710f6e641a6e510cc06f7f66d. started... 2023-03-11 22:53:24,581 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 616fda1710f6e641a6e510cc06f7f66d 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-11 22:53:25,001 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228fac7cb7af70f4501b66d8ece34c66d1c to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151228fac7cb7af70f4501b66d8ece34c66d1c 2023-03-11 22:53:25,012 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithMonthlyPolicy/616fda1710f6e641a6e510cc06f7f66d/.tmp/family1/df7f5d372de84f248ff366d58bf8c738 2023-03-11 22:53:25,021 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithMonthlyPolicy/616fda1710f6e641a6e510cc06f7f66d/.tmp/family1/df7f5d372de84f248ff366d58bf8c738 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithMonthlyPolicy/616fda1710f6e641a6e510cc06f7f66d/family1/df7f5d372de84f248ff366d58bf8c738 2023-03-11 22:53:25,028 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithMonthlyPolicy/616fda1710f6e641a6e510cc06f7f66d/family1/df7f5d372de84f248ff366d58bf8c738, entries=1, sequenceid=21, filesize=4.9 K 2023-03-11 22:53:25,029 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 616fda1710f6e641a6e510cc06f7f66d in 448ms, sequenceid=21, compaction requested=true 2023-03-11 22:53:25,029 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 616fda1710f6e641a6e510cc06f7f66d: 2023-03-11 22:53:25,029 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1678575201009.616fda1710f6e641a6e510cc06f7f66d. 2023-03-11 22:53:25,029 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 22:53:25,029 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 22:53:25,029 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:25,029 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-03-11 22:53:25,029 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-03-11 22:53:25,030 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:25,030 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:25,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:25,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:53:25,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:53:25,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:53:25,032 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:25,032 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 22:53:25,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:53:25,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:25,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:25,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:53:25,036 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-03-11 22:53:25,036 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7514d359[Count = 0] remaining members to acquire global barrier 2023-03-11 22:53:25,036 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-11 22:53:25,036 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:25,037 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:25,037 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:25,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:25,037 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-11 22:53:25,037 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-03-11 22:53:25,037 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,41843,1678575183185' in zk 2023-03-11 22:53:25,038 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:25,039 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-11 22:53:25,039 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 22:53:25,039 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-03-11 22:53:25,039 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 22:53:25,039 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 22:53:25,039 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:25,039 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 22:53:25,040 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-11 22:53:25,040 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:53:25,040 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-03-11 22:53:25,043 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:25,043 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:53:25,043 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:25,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:25,043 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:53:25,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:53:25,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:25,045 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:25,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:25,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:53:25,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:53:25,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:53:25,046 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:25,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:25,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:53:25,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:25,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:25,047 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:25,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:53:25,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:25,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:25,055 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:53:25,056 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:53:25,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:53:25,056 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:53:25,056 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-03-11 22:53:25,057 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 22:53:25,056 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:25,057 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:25,057 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:25,057 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:25,057 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:25,057 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:25,057 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:25,057 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-11 22:53:25,057 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 22:53:25,059 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:53:25,059 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:53:25,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:53:25,141 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-11 22:53:25,157 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 22:53:25,159 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 22:53:25,168 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-11 22:53:25,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-11 22:53:25,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:25,190 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-03-11 22:53:25,190 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:53:25,194 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-11 22:53:25,194 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-11 22:53:25,195 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:25,195 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:25,198 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:25,198 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:53:25,199 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:53:25,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:53:25,199 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:25,199 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 22:53:25,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:25,199 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:25,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 22:53:25,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:25,200 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:25,202 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-03-11 22:53:25,202 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:25,202 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-11 22:53:25,202 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:53:25,204 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-11 22:53:25,206 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 22:53:25,206 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 22:53:25,206 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1678575201009.616fda1710f6e641a6e510cc06f7f66d. 2023-03-11 22:53:25,206 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1678575201009.616fda1710f6e641a6e510cc06f7f66d. started... 2023-03-11 22:53:25,206 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 616fda1710f6e641a6e510cc06f7f66d 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-11 22:53:25,237 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231da11db6a90a540008e7b582b5d4abafc to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151231da11db6a90a540008e7b582b5d4abafc 2023-03-11 22:53:25,644 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithMonthlyPolicy/616fda1710f6e641a6e510cc06f7f66d/.tmp/family1/5c788bf1020f4814b0127a74ddae8087 2023-03-11 22:53:25,652 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithMonthlyPolicy/616fda1710f6e641a6e510cc06f7f66d/.tmp/family1/5c788bf1020f4814b0127a74ddae8087 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithMonthlyPolicy/616fda1710f6e641a6e510cc06f7f66d/family1/5c788bf1020f4814b0127a74ddae8087 2023-03-11 22:53:25,658 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithMonthlyPolicy/616fda1710f6e641a6e510cc06f7f66d/family1/5c788bf1020f4814b0127a74ddae8087, entries=1, sequenceid=25, filesize=4.9 K 2023-03-11 22:53:25,660 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 616fda1710f6e641a6e510cc06f7f66d in 454ms, sequenceid=25, compaction requested=true 2023-03-11 22:53:25,660 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 616fda1710f6e641a6e510cc06f7f66d: 2023-03-11 22:53:25,660 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1678575201009.616fda1710f6e641a6e510cc06f7f66d. 2023-03-11 22:53:25,660 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 22:53:25,660 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 22:53:25,660 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:25,660 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-03-11 22:53:25,660 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-03-11 22:53:25,661 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:25,661 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:25,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:25,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:53:25,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:53:25,661 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:25,662 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 22:53:25,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:53:25,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:53:25,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:25,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:25,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:53:25,663 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-03-11 22:53:25,663 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4d969bbe[Count = 0] remaining members to acquire global barrier 2023-03-11 22:53:25,663 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-11 22:53:25,663 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:25,663 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:25,664 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:25,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:25,664 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-11 22:53:25,664 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-03-11 22:53:25,664 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,41843,1678575183185' in zk 2023-03-11 22:53:25,664 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:25,664 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 22:53:25,665 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-11 22:53:25,665 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:25,665 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:53:25,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:25,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:53:25,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:53:25,665 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-03-11 22:53:25,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:53:25,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:53:25,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:25,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:25,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:53:25,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:25,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:25,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,41843,1678575183185': 2023-03-11 22:53:25,667 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-11 22:53:25,667 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-03-11 22:53:25,668 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 22:53:25,668 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 22:53:25,668 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:25,668 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 22:53:25,669 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:25,669 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:25,669 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:25,669 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:53:25,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:25,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:53:25,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:53:25,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:25,670 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:53:25,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:53:25,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:25,676 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:25,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:53:25,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:25,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:53:25,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:25,678 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:25,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:25,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:53:25,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:25,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:25,688 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:53:25,688 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:53:25,688 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:53:25,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:53:25,688 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:25,688 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:25,688 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:25,688 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:25,688 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:25,688 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:25,688 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:53:25,688 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-03-11 22:53:25,688 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 22:53:25,688 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:25,689 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:53:25,689 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-11 22:53:25,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:53:25,690 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 22:53:25,690 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-11 22:53:25,790 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 22:53:25,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 22:53:25,796 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-11 22:53:25,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-11 22:53:25,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:25,798 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-03-11 22:53:25,798 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:53:25,799 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-11 22:53:25,799 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-11 22:53:25,799 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:25,799 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:25,800 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:25,800 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:53:25,800 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:53:25,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:53:25,800 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:25,800 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 22:53:25,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:25,801 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:25,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 22:53:25,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:25,801 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:25,802 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-03-11 22:53:25,802 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:25,802 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-11 22:53:25,802 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:53:25,803 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-11 22:53:25,803 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 22:53:25,803 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 22:53:25,803 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1678575201009.616fda1710f6e641a6e510cc06f7f66d. 2023-03-11 22:53:25,803 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1678575201009.616fda1710f6e641a6e510cc06f7f66d. started... 2023-03-11 22:53:25,803 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 616fda1710f6e641a6e510cc06f7f66d 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-11 22:53:26,221 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101f539fb95b0ca4d7da9715e1dbed9a2cc to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160101f539fb95b0ca4d7da9715e1dbed9a2cc 2023-03-11 22:53:26,227 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithMonthlyPolicy/616fda1710f6e641a6e510cc06f7f66d/.tmp/family1/916806807d5340f28adb8d7d7b1768f3 2023-03-11 22:53:26,234 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithMonthlyPolicy/616fda1710f6e641a6e510cc06f7f66d/.tmp/family1/916806807d5340f28adb8d7d7b1768f3 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithMonthlyPolicy/616fda1710f6e641a6e510cc06f7f66d/family1/916806807d5340f28adb8d7d7b1768f3 2023-03-11 22:53:26,241 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithMonthlyPolicy/616fda1710f6e641a6e510cc06f7f66d/family1/916806807d5340f28adb8d7d7b1768f3, entries=1, sequenceid=29, filesize=4.9 K 2023-03-11 22:53:26,242 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 616fda1710f6e641a6e510cc06f7f66d in 439ms, sequenceid=29, compaction requested=true 2023-03-11 22:53:26,242 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 616fda1710f6e641a6e510cc06f7f66d: 2023-03-11 22:53:26,242 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1678575201009.616fda1710f6e641a6e510cc06f7f66d. 2023-03-11 22:53:26,242 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 22:53:26,242 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 22:53:26,243 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:26,243 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-03-11 22:53:26,243 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-03-11 22:53:26,244 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:26,244 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:26,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:26,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:53:26,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:53:26,244 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:26,244 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 22:53:26,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:53:26,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:53:26,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:26,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:26,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:53:26,245 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-03-11 22:53:26,245 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@479d5d36[Count = 0] remaining members to acquire global barrier 2023-03-11 22:53:26,245 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-11 22:53:26,245 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:26,246 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:26,246 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:26,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:26,246 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:26,246 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 22:53:26,246 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-11 22:53:26,246 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-03-11 22:53:26,246 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,41843,1678575183185' in zk 2023-03-11 22:53:26,247 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:26,247 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-11 22:53:26,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:26,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:53:26,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:53:26,247 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:53:26,247 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-03-11 22:53:26,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:53:26,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:53:26,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:26,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:26,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:53:26,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:26,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:26,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,41843,1678575183185': 2023-03-11 22:53:26,250 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-11 22:53:26,250 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-03-11 22:53:26,250 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 22:53:26,250 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 22:53:26,250 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:26,250 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 22:53:26,255 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:26,255 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:26,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:26,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:53:26,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:53:26,255 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:26,255 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:53:26,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:26,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:53:26,255 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:26,255 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:53:26,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:53:26,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:26,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:26,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:53:26,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:26,256 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:26,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:26,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:53:26,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:26,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:26,263 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:53:26,263 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:26,263 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:53:26,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:53:26,263 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:53:26,263 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:53:26,263 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-03-11 22:53:26,264 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 22:53:26,263 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:26,264 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:53:26,264 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:26,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:53:26,264 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-11 22:53:26,264 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:26,264 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 22:53:26,264 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:26,264 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:26,264 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:26,265 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-11 22:53:26,364 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 22:53:26,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 22:53:26,372 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-11 22:53:26,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-11 22:53:26,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:26,374 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-03-11 22:53:26,374 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:53:26,375 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-11 22:53:26,375 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-11 22:53:26,375 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:26,375 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:26,376 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:53:26,376 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:26,376 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:53:26,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:53:26,377 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:26,377 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 22:53:26,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:26,377 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:26,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 22:53:26,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:26,377 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:26,378 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-03-11 22:53:26,378 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:26,378 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-11 22:53:26,378 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:53:26,380 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-11 22:53:26,380 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 22:53:26,380 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 22:53:26,380 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1678575201009.616fda1710f6e641a6e510cc06f7f66d. 2023-03-11 22:53:26,380 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1678575201009.616fda1710f6e641a6e510cc06f7f66d. started... 2023-03-11 22:53:26,380 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 616fda1710f6e641a6e510cc06f7f66d 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-11 22:53:26,798 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103b772ecf77f6b4c799dd7505c34b487dd to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160103b772ecf77f6b4c799dd7505c34b487dd 2023-03-11 22:53:26,806 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithMonthlyPolicy/616fda1710f6e641a6e510cc06f7f66d/.tmp/family1/72edabda087748ddba5bf955e5133410 2023-03-11 22:53:26,814 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithMonthlyPolicy/616fda1710f6e641a6e510cc06f7f66d/.tmp/family1/72edabda087748ddba5bf955e5133410 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithMonthlyPolicy/616fda1710f6e641a6e510cc06f7f66d/family1/72edabda087748ddba5bf955e5133410 2023-03-11 22:53:26,819 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithMonthlyPolicy/616fda1710f6e641a6e510cc06f7f66d/family1/72edabda087748ddba5bf955e5133410, entries=1, sequenceid=33, filesize=4.9 K 2023-03-11 22:53:26,820 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 616fda1710f6e641a6e510cc06f7f66d in 440ms, sequenceid=33, compaction requested=true 2023-03-11 22:53:26,821 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 616fda1710f6e641a6e510cc06f7f66d: 2023-03-11 22:53:26,821 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1678575201009.616fda1710f6e641a6e510cc06f7f66d. 2023-03-11 22:53:26,821 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 22:53:26,821 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 22:53:26,821 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:26,821 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-03-11 22:53:26,821 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-03-11 22:53:26,822 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:26,822 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:26,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:26,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:53:26,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:53:26,823 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:26,823 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 22:53:26,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:53:26,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:53:26,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:26,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:26,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:53:26,824 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-03-11 22:53:26,824 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@40e12543[Count = 0] remaining members to acquire global barrier 2023-03-11 22:53:26,824 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-11 22:53:26,824 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:26,828 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:26,828 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:26,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:26,828 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-11 22:53:26,828 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-03-11 22:53:26,828 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,41843,1678575183185' in zk 2023-03-11 22:53:26,828 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:26,828 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 22:53:26,838 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-11 22:53:26,838 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:26,838 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:53:26,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:26,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:53:26,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:53:26,839 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-03-11 22:53:26,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:53:26,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:53:26,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:26,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:26,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:53:26,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:26,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:26,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,41843,1678575183185': 2023-03-11 22:53:26,843 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-11 22:53:26,843 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-03-11 22:53:26,843 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 22:53:26,843 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 22:53:26,843 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:26,843 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 22:53:26,847 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:26,847 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:26,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:26,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:53:26,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:53:26,847 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:26,847 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:53:26,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:26,848 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:26,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:53:26,848 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:53:26,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:53:26,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:26,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:26,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:53:26,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:26,849 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:26,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:26,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:53:26,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:26,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:26,850 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:26,850 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:26,850 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:53:26,850 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:26,851 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:53:26,851 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:53:26,851 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:53:26,851 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-03-11 22:53:26,851 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 22:53:26,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:53:26,851 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:26,851 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-11 22:53:26,851 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:26,852 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:26,852 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:26,852 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-11 22:53:26,852 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 22:53:26,852 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:53:26,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:53:26,952 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 22:53:26,953 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 22:53:26,957 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-11 22:53:26,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-11 22:53:26,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:26,962 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-03-11 22:53:26,962 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:53:26,963 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-11 22:53:26,963 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-11 22:53:26,963 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:26,963 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:26,964 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:53:26,964 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:26,964 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:53:26,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:53:26,964 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:26,964 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 22:53:26,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:26,965 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:26,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 22:53:26,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:26,965 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:26,965 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-03-11 22:53:26,965 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:26,965 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-11 22:53:26,965 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:53:26,966 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-11 22:53:26,966 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 22:53:26,966 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 22:53:26,966 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1678575201009.616fda1710f6e641a6e510cc06f7f66d. 2023-03-11 22:53:26,966 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1678575201009.616fda1710f6e641a6e510cc06f7f66d. started... 2023-03-11 22:53:26,966 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 616fda1710f6e641a6e510cc06f7f66d 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-11 22:53:27,387 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509072430c1606ebe4bd3a1639fa080b3a683 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201509072430c1606ebe4bd3a1639fa080b3a683 2023-03-11 22:53:27,795 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithMonthlyPolicy/616fda1710f6e641a6e510cc06f7f66d/.tmp/family1/b80c50aaddca4b7095709174d821ea28 2023-03-11 22:53:27,802 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithMonthlyPolicy/616fda1710f6e641a6e510cc06f7f66d/.tmp/family1/b80c50aaddca4b7095709174d821ea28 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithMonthlyPolicy/616fda1710f6e641a6e510cc06f7f66d/family1/b80c50aaddca4b7095709174d821ea28 2023-03-11 22:53:27,807 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithMonthlyPolicy/616fda1710f6e641a6e510cc06f7f66d/family1/b80c50aaddca4b7095709174d821ea28, entries=1, sequenceid=37, filesize=4.9 K 2023-03-11 22:53:27,808 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 616fda1710f6e641a6e510cc06f7f66d in 842ms, sequenceid=37, compaction requested=true 2023-03-11 22:53:27,808 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 616fda1710f6e641a6e510cc06f7f66d: 2023-03-11 22:53:27,808 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1678575201009.616fda1710f6e641a6e510cc06f7f66d. 2023-03-11 22:53:27,808 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 22:53:27,808 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 22:53:27,808 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:27,808 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-03-11 22:53:27,808 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-03-11 22:53:27,809 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:27,809 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:27,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:27,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:53:27,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:53:27,810 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:27,810 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 22:53:27,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:53:27,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:53:27,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:27,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:27,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:53:27,811 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-03-11 22:53:27,811 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@133cb81d[Count = 0] remaining members to acquire global barrier 2023-03-11 22:53:27,811 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-11 22:53:27,811 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:27,812 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:27,812 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:27,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:27,812 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-11 22:53:27,812 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-03-11 22:53:27,812 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,41843,1678575183185' in zk 2023-03-11 22:53:27,812 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:27,812 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 22:53:27,813 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:27,813 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-11 22:53:27,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:27,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:53:27,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:53:27,813 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:53:27,813 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-03-11 22:53:27,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:53:27,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:53:27,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:27,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:27,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:53:27,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:27,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:27,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,41843,1678575183185': 2023-03-11 22:53:27,815 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-11 22:53:27,815 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-03-11 22:53:27,815 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 22:53:27,815 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 22:53:27,815 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:27,815 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 22:53:27,816 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:27,816 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:27,816 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:27,816 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:53:27,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:27,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:27,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:53:27,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:53:27,817 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:53:27,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:53:27,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:53:27,817 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:27,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:27,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:27,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:53:27,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:27,818 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:27,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:27,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:53:27,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:27,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:27,819 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:27,819 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:27,819 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:53:27,819 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:27,819 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-03-11 22:53:27,819 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 22:53:27,819 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-11 22:53:27,819 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:53:27,819 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:27,819 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:53:27,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:53:27,819 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:53:27,820 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-11 22:53:27,820 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:27,820 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 22:53:27,820 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:53:27,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:53:27,820 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:27,820 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:27,920 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 22:53:27,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 22:53:27,926 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-11 22:53:27,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-11 22:53:27,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:27,927 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-03-11 22:53:27,927 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:53:27,928 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-11 22:53:27,928 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-11 22:53:27,928 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:27,928 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:27,929 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:53:27,929 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:27,929 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:53:27,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:53:27,930 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:27,930 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 22:53:27,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:27,930 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:27,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 22:53:27,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:27,930 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:27,930 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-03-11 22:53:27,930 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:27,930 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-11 22:53:27,931 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:53:27,932 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-11 22:53:27,932 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 22:53:27,932 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 22:53:27,932 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1678575201009.616fda1710f6e641a6e510cc06f7f66d. 2023-03-11 22:53:27,932 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1678575201009.616fda1710f6e641a6e510cc06f7f66d. started... 2023-03-11 22:53:27,932 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 616fda1710f6e641a6e510cc06f7f66d 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-11 22:53:28,356 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511202439435634c34160aae4e924fff89719 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511202439435634c34160aae4e924fff89719 2023-03-11 22:53:28,764 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithMonthlyPolicy/616fda1710f6e641a6e510cc06f7f66d/.tmp/family1/9a048d81d10947dc8471f18019422160 2023-03-11 22:53:28,780 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithMonthlyPolicy/616fda1710f6e641a6e510cc06f7f66d/.tmp/family1/9a048d81d10947dc8471f18019422160 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithMonthlyPolicy/616fda1710f6e641a6e510cc06f7f66d/family1/9a048d81d10947dc8471f18019422160 2023-03-11 22:53:28,788 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithMonthlyPolicy/616fda1710f6e641a6e510cc06f7f66d/family1/9a048d81d10947dc8471f18019422160, entries=1, sequenceid=41, filesize=4.9 K 2023-03-11 22:53:28,789 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 616fda1710f6e641a6e510cc06f7f66d in 857ms, sequenceid=41, compaction requested=true 2023-03-11 22:53:28,789 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 616fda1710f6e641a6e510cc06f7f66d: 2023-03-11 22:53:28,789 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1678575201009.616fda1710f6e641a6e510cc06f7f66d. 2023-03-11 22:53:28,789 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 22:53:28,789 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 22:53:28,789 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:28,789 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-03-11 22:53:28,789 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-03-11 22:53:28,791 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:28,791 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:28,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:28,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:53:28,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:53:28,791 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:28,791 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 22:53:28,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:53:28,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:53:28,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:28,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:28,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:53:28,792 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-03-11 22:53:28,792 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6a0e9aaf[Count = 0] remaining members to acquire global barrier 2023-03-11 22:53:28,792 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-11 22:53:28,792 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:28,793 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:28,793 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:28,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:28,793 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-11 22:53:28,793 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-03-11 22:53:28,793 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,41843,1678575183185' in zk 2023-03-11 22:53:28,793 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:28,793 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 22:53:28,794 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:28,794 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-11 22:53:28,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:28,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:53:28,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:53:28,794 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:53:28,794 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-03-11 22:53:28,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:53:28,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:53:28,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:28,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:28,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:53:28,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:28,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:28,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,41843,1678575183185': 2023-03-11 22:53:28,797 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-11 22:53:28,797 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-03-11 22:53:28,797 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 22:53:28,797 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 22:53:28,797 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:28,797 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 22:53:28,798 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:28,798 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:28,798 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:28,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:28,798 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:53:28,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:28,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:53:28,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:53:28,798 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:28,798 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:53:28,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:53:28,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:53:28,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:28,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:28,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:53:28,799 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:28,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:28,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:28,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:53:28,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:28,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:28,801 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:28,801 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:53:28,801 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:28,802 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-03-11 22:53:28,802 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 22:53:28,802 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:28,802 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:28,802 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:28,802 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:28,802 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:28,802 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:53:28,802 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:53:28,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:53:28,802 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:53:28,802 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-11 22:53:28,802 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-11 22:53:28,803 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 22:53:28,804 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:53:28,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:53:28,904 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 22:53:28,906 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 22:53:28,909 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=44347] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithMonthlyPolicy 2023-03-11 22:53:28,913 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] procedure2.ProcedureExecutor(1029): Stored pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-03-11 22:53:28,914 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-03-11 22:53:28,915 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithMonthlyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-11 22:53:28,915 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=22, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1678575808915 2023-03-11 22:53:28,916 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-11 22:53:28,918 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithMonthlyPolicy' and column 'family1' 2023-03-11 22:53:28,918 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-03-11 22:53:28,919 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] zookeeper.ReadOnlyZKClient(139): Connect 0x17debda9 to 127.0.0.1:51815 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-11 22:53:28,923 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@33365939, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-11 22:53:28,923 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-03-11 22:53:29,766 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103f124e11282d544fa9b8a093c3d7a8735 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160103f124e11282d544fa9b8a093c3d7a8735 2023-03-11 22:53:29,767 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-03-11 22:53:29,779 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-11 22:53:29,780 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:41408, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-11 22:53:29,788 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-11 22:53:29,789 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:50466, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-11 22:53:29,799 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/444689920bc54bce971a60a1a3d8e281 first=Optional[r5] last=Optional[r6] 2023-03-11 22:53:29,800 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1678575201009.616fda1710f6e641a6e510cc06f7f66d., hostname=jenkins-hbase20.apache.org,41843,1678575183185, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/444689920bc54bce971a60a1a3d8e281}] 2023-03-11 22:53:29,805 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/444689920bc54bce971a60a1a3d8e281 for inclusion in 616fda1710f6e641a6e510cc06f7f66d/family1 2023-03-11 22:53:29,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(775): HFile bounds: first=r5 last=r6 2023-03-11 22:53:29,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(777): Region bounds: first= last= 2023-03-11 22:53:29,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HRegion(2446): Flush status journal for 616fda1710f6e641a6e510cc06f7f66d: 2023-03-11 22:53:29,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/444689920bc54bce971a60a1a3d8e281 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testMajorCompactionWithMonthlyPolicy__tonm635l34fc3l70ou1d0vjep1b9avspi9tkg9jcg2j1jptm8pl1q1n25i1nus0c/family1/444689920bc54bce971a60a1a3d8e281 2023-03-11 22:53:29,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testMajorCompactionWithMonthlyPolicy__tonm635l34fc3l70ou1d0vjep1b9avspi9tkg9jcg2j1jptm8pl1q1n25i1nus0c/family1/444689920bc54bce971a60a1a3d8e281 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithMonthlyPolicy/616fda1710f6e641a6e510cc06f7f66d/family1/7a2254cc97a7489e9b1d1b0b30c57455_SeqId_44_ 2023-03-11 22:53:29,812 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testMajorCompactionWithMonthlyPolicy__tonm635l34fc3l70ou1d0vjep1b9avspi9tkg9jcg2j1jptm8pl1q1n25i1nus0c/family1/444689920bc54bce971a60a1a3d8e281 into 616fda1710f6e641a6e510cc06f7f66d/family1 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithMonthlyPolicy/616fda1710f6e641a6e510cc06f7f66d/family1/7a2254cc97a7489e9b1d1b0b30c57455_SeqId_44_ - updating store file list. 2023-03-11 22:53:29,817 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithMonthlyPolicy/616fda1710f6e641a6e510cc06f7f66d/family1/7a2254cc97a7489e9b1d1b0b30c57455_SeqId_44_ into 616fda1710f6e641a6e510cc06f7f66d/family1 2023-03-11 22:53:29,817 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testMajorCompactionWithMonthlyPolicy__tonm635l34fc3l70ou1d0vjep1b9avspi9tkg9jcg2j1jptm8pl1q1n25i1nus0c/family1/444689920bc54bce971a60a1a3d8e281 into 616fda1710f6e641a6e510cc06f7f66d/family1 (new location: hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithMonthlyPolicy/616fda1710f6e641a6e510cc06f7f66d/family1/7a2254cc97a7489e9b1d1b0b30c57455_SeqId_44_) 2023-03-11 22:53:29,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testMajorCompactionWithMonthlyPolicy__tonm635l34fc3l70ou1d0vjep1b9avspi9tkg9jcg2j1jptm8pl1q1n25i1nus0c/family1/444689920bc54bce971a60a1a3d8e281 2023-03-11 22:53:29,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-03-11 22:53:29,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 50903 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-03-11 22:53:29,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(1912): 616fda1710f6e641a6e510cc06f7f66d/family1 is initiating minor compaction 2023-03-11 22:53:29,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@25dc1fd8; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-11 22:53:29,822 INFO [RS:0;jenkins-hbase20:41843-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 616fda1710f6e641a6e510cc06f7f66d/family1 in testMajorCompactionWithMonthlyPolicy,,1678575201009.616fda1710f6e641a6e510cc06f7f66d. 2023-03-11 22:53:29,822 INFO [RS:0;jenkins-hbase20:41843-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithMonthlyPolicy/616fda1710f6e641a6e510cc06f7f66d/family1/58524c7393d04ba1985d505068b4d867, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithMonthlyPolicy/616fda1710f6e641a6e510cc06f7f66d/family1/bf41caa7e74a4f88bbd3d31436eadf9e, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithMonthlyPolicy/616fda1710f6e641a6e510cc06f7f66d/family1/57bdd2d26b29461ca9abe93bfd1c399c, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithMonthlyPolicy/616fda1710f6e641a6e510cc06f7f66d/family1/df7f5d372de84f248ff366d58bf8c738, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithMonthlyPolicy/616fda1710f6e641a6e510cc06f7f66d/family1/5c788bf1020f4814b0127a74ddae8087, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithMonthlyPolicy/616fda1710f6e641a6e510cc06f7f66d/family1/916806807d5340f28adb8d7d7b1768f3, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithMonthlyPolicy/616fda1710f6e641a6e510cc06f7f66d/family1/72edabda087748ddba5bf955e5133410, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithMonthlyPolicy/616fda1710f6e641a6e510cc06f7f66d/family1/b80c50aaddca4b7095709174d821ea28, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithMonthlyPolicy/616fda1710f6e641a6e510cc06f7f66d/family1/9a048d81d10947dc8471f18019422160, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithMonthlyPolicy/616fda1710f6e641a6e510cc06f7f66d/family1/7a2254cc97a7489e9b1d1b0b30c57455_SeqId_44_] into tmpdir=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithMonthlyPolicy/616fda1710f6e641a6e510cc06f7f66d/.tmp, totalSize=49.7 K 2023-03-11 22:53:29,822 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] compactions.Compactor(207): Compacting 58524c7393d04ba1985d505068b4d867, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-03-11 22:53:29,822 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] compactions.Compactor(207): Compacting bf41caa7e74a4f88bbd3d31436eadf9e, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-03-11 22:53:29,823 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] compactions.Compactor(207): Compacting 57bdd2d26b29461ca9abe93bfd1c399c, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-03-11 22:53:29,823 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] compactions.Compactor(207): Compacting df7f5d372de84f248ff366d58bf8c738, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-03-11 22:53:29,823 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] compactions.Compactor(207): Compacting 5c788bf1020f4814b0127a74ddae8087, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-03-11 22:53:29,823 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] compactions.Compactor(207): Compacting 916806807d5340f28adb8d7d7b1768f3, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-03-11 22:53:29,823 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] compactions.Compactor(207): Compacting 72edabda087748ddba5bf955e5133410, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-03-11 22:53:29,823 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] compactions.Compactor(207): Compacting b80c50aaddca4b7095709174d821ea28, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-03-11 22:53:29,823 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] compactions.Compactor(207): Compacting 9a048d81d10947dc8471f18019422160, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-03-11 22:53:29,823 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] compactions.Compactor(207): Compacting 7a2254cc97a7489e9b1d1b0b30c57455_SeqId_44_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=45 2023-03-11 22:53:29,824 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-03-11 22:53:29,825 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 22:53:29,827 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160101f539fb95b0ca4d7da9715e1dbed9a2cc to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160101f539fb95b0ca4d7da9715e1dbed9a2cc 2023-03-11 22:53:29,828 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160103b772ecf77f6b4c799dd7505c34b487dd to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160103b772ecf77f6b4c799dd7505c34b487dd 2023-03-11 22:53:29,828 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 2 expired mob files are deleted 2023-03-11 22:53:29,828 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101' 2023-03-11 22:53:29,828 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-03-11 22:53:29,828 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-03-11 22:53:29,862 INFO [RS:0;jenkins-hbase20:41843-shortCompactions-0] throttle.PressureAwareThroughputController(145): 616fda1710f6e641a6e510cc06f7f66d#family1#compaction#22 average throughput is 0.27 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-11 22:53:30,679 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithMonthlyPolicy/616fda1710f6e641a6e510cc06f7f66d/.tmp/family1/954d56ecbf73443dae0d21b4733ed326 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithMonthlyPolicy/616fda1710f6e641a6e510cc06f7f66d/family1/954d56ecbf73443dae0d21b4733ed326 2023-03-11 22:53:30,685 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231b985d0027f924ba3bc351d927065a3f1 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151231b985d0027f924ba3bc351d927065a3f1 2023-03-11 22:53:30,686 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-03-11 22:53:30,689 INFO [RS:0;jenkins-hbase20:41843-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 616fda1710f6e641a6e510cc06f7f66d/family1 of 616fda1710f6e641a6e510cc06f7f66d into 954d56ecbf73443dae0d21b4733ed326(size=6.6 K), total size for store is 172.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-11 22:53:30,689 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 616fda1710f6e641a6e510cc06f7f66d: 2023-03-11 22:53:30,689 INFO [RS:0;jenkins-hbase20:41843-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithMonthlyPolicy,,1678575201009.616fda1710f6e641a6e510cc06f7f66d., storeName=family1, fileCount=10, fileSize=49.7 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.2 K), priority=2, time=1678575209822; duration=0sec 2023-03-11 22:53:30,689 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-11 22:53:30,726 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/a8781ac2961c4e449af70453be8a51b4 first=Optional[r1] last=Optional[r4] 2023-03-11 22:53:30,727 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1678575201009.616fda1710f6e641a6e510cc06f7f66d., hostname=jenkins-hbase20.apache.org,41843,1678575183185, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/a8781ac2961c4e449af70453be8a51b4}] 2023-03-11 22:53:30,729 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/a8781ac2961c4e449af70453be8a51b4 for inclusion in 616fda1710f6e641a6e510cc06f7f66d/family1 2023-03-11 22:53:30,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(775): HFile bounds: first=r1 last=r4 2023-03-11 22:53:30,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(777): Region bounds: first= last= 2023-03-11 22:53:30,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HRegion(2446): Flush status journal for 616fda1710f6e641a6e510cc06f7f66d: 2023-03-11 22:53:30,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/a8781ac2961c4e449af70453be8a51b4 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testMajorCompactionWithMonthlyPolicy__gh5ptslpeci9msvkqj3ib0s95ojsah4s47am53h07gn6r5b60sal306hhir9ssr7/family1/a8781ac2961c4e449af70453be8a51b4 2023-03-11 22:53:30,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testMajorCompactionWithMonthlyPolicy__gh5ptslpeci9msvkqj3ib0s95ojsah4s47am53h07gn6r5b60sal306hhir9ssr7/family1/a8781ac2961c4e449af70453be8a51b4 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithMonthlyPolicy/616fda1710f6e641a6e510cc06f7f66d/family1/68cccdb2e72b4798ba4e7d0d0b37f57b_SeqId_47_ 2023-03-11 22:53:30,738 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testMajorCompactionWithMonthlyPolicy__gh5ptslpeci9msvkqj3ib0s95ojsah4s47am53h07gn6r5b60sal306hhir9ssr7/family1/a8781ac2961c4e449af70453be8a51b4 into 616fda1710f6e641a6e510cc06f7f66d/family1 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithMonthlyPolicy/616fda1710f6e641a6e510cc06f7f66d/family1/68cccdb2e72b4798ba4e7d0d0b37f57b_SeqId_47_ - updating store file list. 2023-03-11 22:53:30,744 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithMonthlyPolicy/616fda1710f6e641a6e510cc06f7f66d/family1/68cccdb2e72b4798ba4e7d0d0b37f57b_SeqId_47_ into 616fda1710f6e641a6e510cc06f7f66d/family1 2023-03-11 22:53:30,744 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testMajorCompactionWithMonthlyPolicy__gh5ptslpeci9msvkqj3ib0s95ojsah4s47am53h07gn6r5b60sal306hhir9ssr7/family1/a8781ac2961c4e449af70453be8a51b4 into 616fda1710f6e641a6e510cc06f7f66d/family1 (new location: hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithMonthlyPolicy/616fda1710f6e641a6e510cc06f7f66d/family1/68cccdb2e72b4798ba4e7d0d0b37f57b_SeqId_47_) 2023-03-11 22:53:30,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testMajorCompactionWithMonthlyPolicy__gh5ptslpeci9msvkqj3ib0s95ojsah4s47am53h07gn6r5b60sal306hhir9ssr7/family1/a8781ac2961c4e449af70453be8a51b4 2023-03-11 22:53:30,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-03-11 22:53:30,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 182349 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-03-11 22:53:30,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(1912): 616fda1710f6e641a6e510cc06f7f66d/family1 is initiating minor compaction (all files) 2023-03-11 22:53:30,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@794d6995; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-11 22:53:30,747 INFO [RS:0;jenkins-hbase20:41843-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 616fda1710f6e641a6e510cc06f7f66d/family1 in testMajorCompactionWithMonthlyPolicy,,1678575201009.616fda1710f6e641a6e510cc06f7f66d. 2023-03-11 22:53:30,747 INFO [RS:0;jenkins-hbase20:41843-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithMonthlyPolicy/616fda1710f6e641a6e510cc06f7f66d/family1/c2fdb89c13714de58b0de51f46248d8a, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithMonthlyPolicy/616fda1710f6e641a6e510cc06f7f66d/family1/954d56ecbf73443dae0d21b4733ed326, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithMonthlyPolicy/616fda1710f6e641a6e510cc06f7f66d/family1/68cccdb2e72b4798ba4e7d0d0b37f57b_SeqId_47_] into tmpdir=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithMonthlyPolicy/616fda1710f6e641a6e510cc06f7f66d/.tmp, totalSize=178.1 K 2023-03-11 22:53:30,748 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] compactions.Compactor(207): Compacting c2fdb89c13714de58b0de51f46248d8a, keycount=1000, bloomtype=ROW, size=166.0 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878807597 2023-03-11 22:53:30,748 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] compactions.Compactor(207): Compacting 954d56ecbf73443dae0d21b4733ed326, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621207597 2023-03-11 22:53:30,749 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] compactions.Compactor(207): Compacting 68cccdb2e72b4798ba4e7d0d0b37f57b_SeqId_47_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965207597 2023-03-11 22:53:30,751 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-03-11 22:53:30,752 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 22:53:30,756 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151201d8e68acdcee443e2951e53be064eff32 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151201d8e68acdcee443e2951e53be064eff32 2023-03-11 22:53:30,758 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015120501ee27a4f7284a7ebcf377713e32cf8d to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015120501ee27a4f7284a7ebcf377713e32cf8d 2023-03-11 22:53:30,761 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151228fac7cb7af70f4501b66d8ece34c66d1c to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151228fac7cb7af70f4501b66d8ece34c66d1c 2023-03-11 22:53:30,763 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151231da11db6a90a540008e7b582b5d4abafc to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151231da11db6a90a540008e7b582b5d4abafc 2023-03-11 22:53:30,763 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 4 expired mob files are deleted 2023-03-11 22:53:30,763 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201' 2023-03-11 22:53:30,764 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-03-11 22:53:30,764 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-03-11 22:53:30,794 INFO [RS:0;jenkins-hbase20:41843-shortCompactions-0] throttle.PressureAwareThroughputController(145): 616fda1710f6e641a6e510cc06f7f66d#family1#compaction#23 average throughput is 5.98 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-11 22:53:30,806 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithMonthlyPolicy/616fda1710f6e641a6e510cc06f7f66d/family1/58524c7393d04ba1985d505068b4d867, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithMonthlyPolicy/616fda1710f6e641a6e510cc06f7f66d/family1/bf41caa7e74a4f88bbd3d31436eadf9e, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithMonthlyPolicy/616fda1710f6e641a6e510cc06f7f66d/family1/57bdd2d26b29461ca9abe93bfd1c399c, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithMonthlyPolicy/616fda1710f6e641a6e510cc06f7f66d/family1/df7f5d372de84f248ff366d58bf8c738, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithMonthlyPolicy/616fda1710f6e641a6e510cc06f7f66d/family1/5c788bf1020f4814b0127a74ddae8087, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithMonthlyPolicy/616fda1710f6e641a6e510cc06f7f66d/family1/916806807d5340f28adb8d7d7b1768f3, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithMonthlyPolicy/616fda1710f6e641a6e510cc06f7f66d/family1/72edabda087748ddba5bf955e5133410, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithMonthlyPolicy/616fda1710f6e641a6e510cc06f7f66d/family1/b80c50aaddca4b7095709174d821ea28, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithMonthlyPolicy/616fda1710f6e641a6e510cc06f7f66d/family1/9a048d81d10947dc8471f18019422160, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithMonthlyPolicy/616fda1710f6e641a6e510cc06f7f66d/family1/7a2254cc97a7489e9b1d1b0b30c57455_SeqId_44_] to archive 2023-03-11 22:53:30,809 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 22:53:30,811 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithMonthlyPolicy/616fda1710f6e641a6e510cc06f7f66d/family1/58524c7393d04ba1985d505068b4d867 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionWithMonthlyPolicy/616fda1710f6e641a6e510cc06f7f66d/family1/58524c7393d04ba1985d505068b4d867 2023-03-11 22:53:30,814 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithMonthlyPolicy/616fda1710f6e641a6e510cc06f7f66d/family1/bf41caa7e74a4f88bbd3d31436eadf9e to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionWithMonthlyPolicy/616fda1710f6e641a6e510cc06f7f66d/family1/bf41caa7e74a4f88bbd3d31436eadf9e 2023-03-11 22:53:30,817 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithMonthlyPolicy/616fda1710f6e641a6e510cc06f7f66d/family1/57bdd2d26b29461ca9abe93bfd1c399c to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionWithMonthlyPolicy/616fda1710f6e641a6e510cc06f7f66d/family1/57bdd2d26b29461ca9abe93bfd1c399c 2023-03-11 22:53:30,821 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithMonthlyPolicy/616fda1710f6e641a6e510cc06f7f66d/family1/df7f5d372de84f248ff366d58bf8c738 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionWithMonthlyPolicy/616fda1710f6e641a6e510cc06f7f66d/family1/df7f5d372de84f248ff366d58bf8c738 2023-03-11 22:53:30,824 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithMonthlyPolicy/616fda1710f6e641a6e510cc06f7f66d/family1/5c788bf1020f4814b0127a74ddae8087 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionWithMonthlyPolicy/616fda1710f6e641a6e510cc06f7f66d/family1/5c788bf1020f4814b0127a74ddae8087 2023-03-11 22:53:30,826 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithMonthlyPolicy/616fda1710f6e641a6e510cc06f7f66d/family1/916806807d5340f28adb8d7d7b1768f3 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionWithMonthlyPolicy/616fda1710f6e641a6e510cc06f7f66d/family1/916806807d5340f28adb8d7d7b1768f3 2023-03-11 22:53:30,828 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithMonthlyPolicy/616fda1710f6e641a6e510cc06f7f66d/family1/72edabda087748ddba5bf955e5133410 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionWithMonthlyPolicy/616fda1710f6e641a6e510cc06f7f66d/family1/72edabda087748ddba5bf955e5133410 2023-03-11 22:53:30,830 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithMonthlyPolicy/616fda1710f6e641a6e510cc06f7f66d/family1/b80c50aaddca4b7095709174d821ea28 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionWithMonthlyPolicy/616fda1710f6e641a6e510cc06f7f66d/family1/b80c50aaddca4b7095709174d821ea28 2023-03-11 22:53:30,832 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithMonthlyPolicy/616fda1710f6e641a6e510cc06f7f66d/family1/9a048d81d10947dc8471f18019422160 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionWithMonthlyPolicy/616fda1710f6e641a6e510cc06f7f66d/family1/9a048d81d10947dc8471f18019422160 2023-03-11 22:53:30,836 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithMonthlyPolicy/616fda1710f6e641a6e510cc06f7f66d/family1/7a2254cc97a7489e9b1d1b0b30c57455_SeqId_44_ to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionWithMonthlyPolicy/616fda1710f6e641a6e510cc06f7f66d/family1/7a2254cc97a7489e9b1d1b0b30c57455_SeqId_44_ 2023-03-11 22:53:30,877 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithMonthlyPolicy/616fda1710f6e641a6e510cc06f7f66d/.tmp/family1/1d6da26978b2470e8acc37a9bcc377b6 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithMonthlyPolicy/616fda1710f6e641a6e510cc06f7f66d/family1/1d6da26978b2470e8acc37a9bcc377b6 2023-03-11 22:53:30,885 INFO [RS:0;jenkins-hbase20:41843-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 616fda1710f6e641a6e510cc06f7f66d/family1 of 616fda1710f6e641a6e510cc06f7f66d into 1d6da26978b2470e8acc37a9bcc377b6(size=167.4 K), total size for store is 167.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-11 22:53:30,885 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 616fda1710f6e641a6e510cc06f7f66d: 2023-03-11 22:53:30,885 INFO [RS:0;jenkins-hbase20:41843-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithMonthlyPolicy,,1678575201009.616fda1710f6e641a6e510cc06f7f66d., storeName=family1, fileCount=3, fileSize=178.1 K (166.0 K, 6.6 K, 5.5 K), priority=2, time=1678575210746; duration=0sec 2023-03-11 22:53:30,886 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-11 22:53:30,964 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithMonthlyPolicy/616fda1710f6e641a6e510cc06f7f66d/family1/c2fdb89c13714de58b0de51f46248d8a, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithMonthlyPolicy/616fda1710f6e641a6e510cc06f7f66d/family1/954d56ecbf73443dae0d21b4733ed326, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithMonthlyPolicy/616fda1710f6e641a6e510cc06f7f66d/family1/68cccdb2e72b4798ba4e7d0d0b37f57b_SeqId_47_] to archive 2023-03-11 22:53:30,965 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 22:53:30,968 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithMonthlyPolicy/616fda1710f6e641a6e510cc06f7f66d/family1/c2fdb89c13714de58b0de51f46248d8a to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionWithMonthlyPolicy/616fda1710f6e641a6e510cc06f7f66d/family1/c2fdb89c13714de58b0de51f46248d8a 2023-03-11 22:53:30,969 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithMonthlyPolicy/616fda1710f6e641a6e510cc06f7f66d/family1/954d56ecbf73443dae0d21b4733ed326 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionWithMonthlyPolicy/616fda1710f6e641a6e510cc06f7f66d/family1/954d56ecbf73443dae0d21b4733ed326 2023-03-11 22:53:30,971 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithMonthlyPolicy/616fda1710f6e641a6e510cc06f7f66d/family1/68cccdb2e72b4798ba4e7d0d0b37f57b_SeqId_47_ to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionWithMonthlyPolicy/616fda1710f6e641a6e510cc06f7f66d/family1/68cccdb2e72b4798ba4e7d0d0b37f57b_SeqId_47_ 2023-03-11 22:53:31,303 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130097e9dadc9c34895bf6f44ee1d4a0e1a to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151130097e9dadc9c34895bf6f44ee1d4a0e1a 2023-03-11 22:53:31,304 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-03-11 22:53:31,328 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/5cae54c7dd5948a9800a047a4c090d3c first=Optional[r00] last=Optional[r8] 2023-03-11 22:53:31,329 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1678575201009.616fda1710f6e641a6e510cc06f7f66d., hostname=jenkins-hbase20.apache.org,41843,1678575183185, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/5cae54c7dd5948a9800a047a4c090d3c}] 2023-03-11 22:53:31,331 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/5cae54c7dd5948a9800a047a4c090d3c for inclusion in 616fda1710f6e641a6e510cc06f7f66d/family1 2023-03-11 22:53:31,335 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(775): HFile bounds: first=r00 last=r8 2023-03-11 22:53:31,335 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(777): Region bounds: first= last= 2023-03-11 22:53:31,335 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HRegion(2446): Flush status journal for 616fda1710f6e641a6e510cc06f7f66d: 2023-03-11 22:53:31,336 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/5cae54c7dd5948a9800a047a4c090d3c to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testMajorCompactionWithMonthlyPolicy__juqrsr2fkc559jvouqtql1o4ghb91ds3797ilpb41bi6k1p4sa66nl6unragbkbn/family1/5cae54c7dd5948a9800a047a4c090d3c 2023-03-11 22:53:31,339 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testMajorCompactionWithMonthlyPolicy__juqrsr2fkc559jvouqtql1o4ghb91ds3797ilpb41bi6k1p4sa66nl6unragbkbn/family1/5cae54c7dd5948a9800a047a4c090d3c as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithMonthlyPolicy/616fda1710f6e641a6e510cc06f7f66d/family1/6e48e7e76d2d4a46ac2e02318044b571_SeqId_50_ 2023-03-11 22:53:31,340 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testMajorCompactionWithMonthlyPolicy__juqrsr2fkc559jvouqtql1o4ghb91ds3797ilpb41bi6k1p4sa66nl6unragbkbn/family1/5cae54c7dd5948a9800a047a4c090d3c into 616fda1710f6e641a6e510cc06f7f66d/family1 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithMonthlyPolicy/616fda1710f6e641a6e510cc06f7f66d/family1/6e48e7e76d2d4a46ac2e02318044b571_SeqId_50_ - updating store file list. 2023-03-11 22:53:31,344 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithMonthlyPolicy/616fda1710f6e641a6e510cc06f7f66d/family1/6e48e7e76d2d4a46ac2e02318044b571_SeqId_50_ into 616fda1710f6e641a6e510cc06f7f66d/family1 2023-03-11 22:53:31,344 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testMajorCompactionWithMonthlyPolicy__juqrsr2fkc559jvouqtql1o4ghb91ds3797ilpb41bi6k1p4sa66nl6unragbkbn/family1/5cae54c7dd5948a9800a047a4c090d3c into 616fda1710f6e641a6e510cc06f7f66d/family1 (new location: hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithMonthlyPolicy/616fda1710f6e641a6e510cc06f7f66d/family1/6e48e7e76d2d4a46ac2e02318044b571_SeqId_50_) 2023-03-11 22:53:31,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testMajorCompactionWithMonthlyPolicy__juqrsr2fkc559jvouqtql1o4ghb91ds3797ilpb41bi6k1p4sa66nl6unragbkbn/family1/5cae54c7dd5948a9800a047a4c090d3c 2023-03-11 22:53:31,347 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-03-11 22:53:31,348 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 22:53:31,349 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511202439435634c34160aae4e924fff89719 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511202439435634c34160aae4e924fff89719 2023-03-11 22:53:31,350 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511288eb085a4c1d04457a8a75b09eb887e79 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511288eb085a4c1d04457a8a75b09eb887e79 2023-03-11 22:53:31,350 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151130f8228bc9a2eb4c7092b75f92c8ec9aaf to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151130f8228bc9a2eb4c7092b75f92c8ec9aaf 2023-03-11 22:53:31,351 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 3 expired mob files are deleted 2023-03-11 22:53:31,351 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-03-11 22:53:31,351 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-03-11 22:53:31,351 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-03-11 22:53:31,351 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-03-11 22:53:31,351 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-03-11 22:53:31,351 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithMonthlyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-11 22:53:31,352 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=22, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-03-11 22:53:31,353 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=22, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE in 2.4410 sec 2023-03-11 22:53:31,469 INFO [Listener at localhost.localdomain/41563] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithMonthlyPolicy Thread=255 (was 246) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:51815@0x17debda9-SendThread(127.0.0.1:51815) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/87368fcc-6f9d-8d4a-6393-acc3a85b6a4f/cluster_01183c7b-d60b-1c38-923f-d300051bd96f/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3fd43526-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3fd43526-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2108950010_15 at /127.0.0.1:33768 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/87368fcc-6f9d-8d4a-6393-acc3a85b6a4f/cluster_01183c7b-d60b-1c38-923f-d300051bd96f/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3fd43526-shared-pool-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2108950010_15 at /127.0.0.1:33882 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2108950010_15 at /127.0.0.1:34036 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3fd43526-shared-pool-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2108950010_15 at /127.0.0.1:33898 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3fd43526-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2108950010_15 at /127.0.0.1:33982 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2108950010_15 at /127.0.0.1:33930 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2108950010_15 at /127.0.0.1:33944 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3fd43526-shared-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2108950010_15 at /127.0.0.1:33846 [Waiting for operation #18] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2108950010_15 at /127.0.0.1:33840 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_267214471_15 at /127.0.0.1:34046 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2108950010_15 at /127.0.0.1:33908 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_267214471_15 at /127.0.0.1:33952 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:51815@0x17debda9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$45/1628759669.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:51815@0x17debda9-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2108950010_15 at /127.0.0.1:33866 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2108950010_15 at /127.0.0.1:33924 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3fd43526-shared-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2108950010_15 at /127.0.0.1:33964 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2108950010_15 at /127.0.0.1:33948 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2108950010_15 at /127.0.0.1:33832 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=609 (was 591) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=390 (was 379) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=21825 (was 21894) 2023-03-11 22:53:31,481 INFO [Listener at localhost.localdomain/41563] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompactionWithWeeklyPolicy Thread=255, OpenFileDescriptor=609, MaxFileDescriptor=60000, SystemLoadAverage=390, ProcessCount=168, AvailableMemoryMB=21823 2023-03-11 22:53:31,483 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testMinorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-03-11 22:53:31,485 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure2.ProcedureExecutor(1029): Stored pid=23, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:31,486 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-03-11 22:53:31,487 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(697): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testMinorCompactionWithWeeklyPolicy" procId is: 23 2023-03-11 22:53:31,487 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-11 22:53:31,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-03-11 22:53:31,489 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/7a35b3ad186d84bd239e22f355d22d96 2023-03-11 22:53:31,490 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/7a35b3ad186d84bd239e22f355d22d96 empty. 2023-03-11 22:53:31,490 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/7a35b3ad186d84bd239e22f355d22d96 2023-03-11 22:53:31,490 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testMinorCompactionWithWeeklyPolicy regions 2023-03-11 22:53:31,533 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-11 22:53:31,534 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x17debda9 to 127.0.0.1:51815 2023-03-11 22:53:31,534 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-11 22:53:31,536 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-11 22:53:31,536 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x71d12e1b to 127.0.0.1:51815 2023-03-11 22:53:31,536 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-11 22:53:31,536 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-11 22:53:31,536 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7fef5580 to 127.0.0.1:51815 2023-03-11 22:53:31,536 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-11 22:53:31,540 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/.tabledesc/.tableinfo.0000000001 2023-03-11 22:53:31,541 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => 7a35b3ad186d84bd239e22f355d22d96, NAME => 'testMinorCompactionWithWeeklyPolicy,,1678575211483.7a35b3ad186d84bd239e22f355d22d96.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMinorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/.tmp 2023-03-11 22:53:31,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-03-11 22:53:31,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-03-11 22:53:31,949 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithWeeklyPolicy,,1678575211483.7a35b3ad186d84bd239e22f355d22d96.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-11 22:53:31,949 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1604): Closing 7a35b3ad186d84bd239e22f355d22d96, disabling compactions & flushes 2023-03-11 22:53:31,949 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithWeeklyPolicy,,1678575211483.7a35b3ad186d84bd239e22f355d22d96. 2023-03-11 22:53:31,949 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithWeeklyPolicy,,1678575211483.7a35b3ad186d84bd239e22f355d22d96. 2023-03-11 22:53:31,949 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithWeeklyPolicy,,1678575211483.7a35b3ad186d84bd239e22f355d22d96. after waiting 0 ms 2023-03-11 22:53:31,949 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithWeeklyPolicy,,1678575211483.7a35b3ad186d84bd239e22f355d22d96. 2023-03-11 22:53:31,949 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1838): Closed testMinorCompactionWithWeeklyPolicy,,1678575211483.7a35b3ad186d84bd239e22f355d22d96. 2023-03-11 22:53:31,949 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for 7a35b3ad186d84bd239e22f355d22d96: 2023-03-11 22:53:31,955 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-03-11 22:53:31,958 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMinorCompactionWithWeeklyPolicy,,1678575211483.7a35b3ad186d84bd239e22f355d22d96.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1678575211958"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678575211958"}]},"ts":"1678575211958"} 2023-03-11 22:53:31,962 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-03-11 22:53:31,964 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-11 22:53:31,964 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678575211964"}]},"ts":"1678575211964"} 2023-03-11 22:53:31,966 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithWeeklyPolicy, state=ENABLING in hbase:meta 2023-03-11 22:53:31,969 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=7a35b3ad186d84bd239e22f355d22d96, ASSIGN}] 2023-03-11 22:53:31,971 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=7a35b3ad186d84bd239e22f355d22d96, ASSIGN 2023-03-11 22:53:31,972 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=7a35b3ad186d84bd239e22f355d22d96, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,41843,1678575183185; forceNewPlan=false, retain=false 2023-03-11 22:53:32,091 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-03-11 22:53:32,123 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=7a35b3ad186d84bd239e22f355d22d96, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:32,124 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMinorCompactionWithWeeklyPolicy,,1678575211483.7a35b3ad186d84bd239e22f355d22d96.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1678575212123"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1678575212123"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678575212123"}]},"ts":"1678575212123"} 2023-03-11 22:53:32,126 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=24, state=RUNNABLE; OpenRegionProcedure 7a35b3ad186d84bd239e22f355d22d96, server=jenkins-hbase20.apache.org,41843,1678575183185}] 2023-03-11 22:53:32,285 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testMinorCompactionWithWeeklyPolicy,,1678575211483.7a35b3ad186d84bd239e22f355d22d96. 2023-03-11 22:53:32,286 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7a35b3ad186d84bd239e22f355d22d96, NAME => 'testMinorCompactionWithWeeklyPolicy,,1678575211483.7a35b3ad186d84bd239e22f355d22d96.', STARTKEY => '', ENDKEY => ''} 2023-03-11 22:53:32,286 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompactionWithWeeklyPolicy 7a35b3ad186d84bd239e22f355d22d96 2023-03-11 22:53:32,287 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithWeeklyPolicy,,1678575211483.7a35b3ad186d84bd239e22f355d22d96.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-11 22:53:32,287 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 7a35b3ad186d84bd239e22f355d22d96 2023-03-11 22:53:32,287 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 7a35b3ad186d84bd239e22f355d22d96 2023-03-11 22:53:32,290 INFO [StoreOpener-7a35b3ad186d84bd239e22f355d22d96-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 7a35b3ad186d84bd239e22f355d22d96 2023-03-11 22:53:32,292 DEBUG [StoreOpener-7a35b3ad186d84bd239e22f355d22d96-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithWeeklyPolicy/7a35b3ad186d84bd239e22f355d22d96/family1 2023-03-11 22:53:32,292 DEBUG [StoreOpener-7a35b3ad186d84bd239e22f355d22d96-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithWeeklyPolicy/7a35b3ad186d84bd239e22f355d22d96/family1 2023-03-11 22:53:32,292 INFO [StoreOpener-7a35b3ad186d84bd239e22f355d22d96-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7a35b3ad186d84bd239e22f355d22d96 columnFamilyName family1 2023-03-11 22:53:32,294 INFO [StoreOpener-7a35b3ad186d84bd239e22f355d22d96-1] regionserver.HStore(310): Store=7a35b3ad186d84bd239e22f355d22d96/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-11 22:53:32,295 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithWeeklyPolicy/7a35b3ad186d84bd239e22f355d22d96 2023-03-11 22:53:32,296 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithWeeklyPolicy/7a35b3ad186d84bd239e22f355d22d96 2023-03-11 22:53:32,299 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 7a35b3ad186d84bd239e22f355d22d96 2023-03-11 22:53:32,302 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithWeeklyPolicy/7a35b3ad186d84bd239e22f355d22d96/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-11 22:53:32,303 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 7a35b3ad186d84bd239e22f355d22d96; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72711108, jitterRate=0.08347994089126587}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-11 22:53:32,303 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 7a35b3ad186d84bd239e22f355d22d96: 2023-03-11 22:53:32,305 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMinorCompactionWithWeeklyPolicy,,1678575211483.7a35b3ad186d84bd239e22f355d22d96., pid=25, masterSystemTime=1678575212279 2023-03-11 22:53:32,306 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMinorCompactionWithWeeklyPolicy,,1678575211483.7a35b3ad186d84bd239e22f355d22d96. 2023-03-11 22:53:32,307 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testMinorCompactionWithWeeklyPolicy,,1678575211483.7a35b3ad186d84bd239e22f355d22d96. 2023-03-11 22:53:32,307 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=7a35b3ad186d84bd239e22f355d22d96, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:32,307 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMinorCompactionWithWeeklyPolicy,,1678575211483.7a35b3ad186d84bd239e22f355d22d96.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1678575212307"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1678575212307"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678575212307"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678575212307"}]},"ts":"1678575212307"} 2023-03-11 22:53:32,311 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=24 2023-03-11 22:53:32,311 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=24, state=SUCCESS; OpenRegionProcedure 7a35b3ad186d84bd239e22f355d22d96, server=jenkins-hbase20.apache.org,41843,1678575183185 in 183 msec 2023-03-11 22:53:32,313 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=23 2023-03-11 22:53:32,313 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=23, state=SUCCESS; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=7a35b3ad186d84bd239e22f355d22d96, ASSIGN in 342 msec 2023-03-11 22:53:32,314 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-11 22:53:32,314 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678575212314"}]},"ts":"1678575212314"} 2023-03-11 22:53:32,315 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithWeeklyPolicy, state=ENABLED in hbase:meta 2023-03-11 22:53:32,317 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-03-11 22:53:32,319 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=23, state=SUCCESS; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy in 834 msec 2023-03-11 22:53:32,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-03-11 22:53:32,593 INFO [Listener at localhost.localdomain/41563] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMinorCompactionWithWeeklyPolicy, procId: 23 completed 2023-03-11 22:53:32,621 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-11 22:53:32,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:32,623 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-03-11 22:53:32,623 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:53:32,623 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-11 22:53:32,623 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-11 22:53:32,623 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:32,623 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:32,624 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:53:32,624 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:32,624 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:53:32,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:53:32,625 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:32,625 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 22:53:32,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:32,625 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:32,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 22:53:32,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:32,625 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:32,626 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:32,626 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-11 22:53:32,626 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:53:32,626 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-11 22:53:32,626 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 22:53:32,626 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 22:53:32,626 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1678575211483.7a35b3ad186d84bd239e22f355d22d96. 2023-03-11 22:53:32,626 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1678575211483.7a35b3ad186d84bd239e22f355d22d96. started... 2023-03-11 22:53:32,627 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 7a35b3ad186d84bd239e22f355d22d96 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-03-11 22:53:33,050 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511300478bfcb2cc74fa286d0311164b1e15b to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201511300478bfcb2cc74fa286d0311164b1e15b 2023-03-11 22:53:33,455 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithWeeklyPolicy/7a35b3ad186d84bd239e22f355d22d96/.tmp/family1/3de38c94fd3b4535b71a065eb98ab2b1 2023-03-11 22:53:33,462 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithWeeklyPolicy/7a35b3ad186d84bd239e22f355d22d96/.tmp/family1/3de38c94fd3b4535b71a065eb98ab2b1 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithWeeklyPolicy/7a35b3ad186d84bd239e22f355d22d96/family1/3de38c94fd3b4535b71a065eb98ab2b1 2023-03-11 22:53:33,469 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithWeeklyPolicy/7a35b3ad186d84bd239e22f355d22d96/family1/3de38c94fd3b4535b71a065eb98ab2b1, entries=1000, sequenceid=5, filesize=165.1 K 2023-03-11 22:53:33,471 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 7a35b3ad186d84bd239e22f355d22d96 in 844ms, sequenceid=5, compaction requested=false 2023-03-11 22:53:33,471 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMinorCompactionWithWeeklyPolicy' 2023-03-11 22:53:33,471 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7a35b3ad186d84bd239e22f355d22d96: 2023-03-11 22:53:33,472 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1678575211483.7a35b3ad186d84bd239e22f355d22d96. 2023-03-11 22:53:33,472 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 22:53:33,472 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 22:53:33,472 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:33,472 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-03-11 22:53:33,472 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-03-11 22:53:33,474 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:33,474 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:33,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:33,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:53:33,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:53:33,474 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:33,474 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 22:53:33,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:53:33,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:53:33,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:33,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:33,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:53:33,476 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-03-11 22:53:33,476 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@47570e35[Count = 0] remaining members to acquire global barrier 2023-03-11 22:53:33,476 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-11 22:53:33,476 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:33,477 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:33,477 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:33,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:33,477 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-11 22:53:33,477 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-03-11 22:53:33,477 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,41843,1678575183185' in zk 2023-03-11 22:53:33,477 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:33,477 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 22:53:33,478 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:33,478 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-11 22:53:33,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:33,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:53:33,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:53:33,479 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:53:33,479 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-03-11 22:53:33,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:53:33,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:53:33,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:33,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:33,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:53:33,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:33,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:33,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,41843,1678575183185': 2023-03-11 22:53:33,481 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-11 22:53:33,481 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-03-11 22:53:33,482 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 22:53:33,482 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 22:53:33,482 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:33,482 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 22:53:33,488 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:33,488 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:33,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:33,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:53:33,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:53:33,488 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:33,488 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:53:33,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:33,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:53:33,489 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:53:33,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:53:33,489 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:33,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:33,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:33,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:53:33,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:33,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:33,491 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:33,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:53:33,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:33,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:33,497 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:33,497 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:33,497 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:53:33,497 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-11 22:53:33,497 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-03-11 22:53:33,497 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 22:53:33,497 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:53:33,497 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:33,497 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:53:33,497 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-11 22:53:33,497 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:53:33,498 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 22:53:33,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:53:33,497 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:33,498 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:33,499 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:33,499 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:33,499 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:53:33,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:53:33,598 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 22:53:33,600 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 22:53:33,608 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-11 22:53:33,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-11 22:53:33,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:33,612 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-03-11 22:53:33,612 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:53:33,613 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-11 22:53:33,613 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-11 22:53:33,614 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:33,614 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:33,615 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:53:33,615 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:33,615 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:53:33,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:53:33,616 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:33,616 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 22:53:33,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:33,617 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:33,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 22:53:33,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:33,618 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:33,618 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-03-11 22:53:33,618 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:33,618 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-11 22:53:33,618 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:53:33,618 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-11 22:53:33,619 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 22:53:33,619 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 22:53:33,619 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1678575211483.7a35b3ad186d84bd239e22f355d22d96. 2023-03-11 22:53:33,619 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1678575211483.7a35b3ad186d84bd239e22f355d22d96. started... 2023-03-11 22:53:33,619 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 7a35b3ad186d84bd239e22f355d22d96 1/1 column families, dataSize=74 B heapSize=408 B 2023-03-11 22:53:34,044 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511282be0aec4a6e34d3da7ac06c0a77289b5 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201511282be0aec4a6e34d3da7ac06c0a77289b5 2023-03-11 22:53:34,452 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithWeeklyPolicy/7a35b3ad186d84bd239e22f355d22d96/.tmp/family1/76a666e886994e81bf7097172f0f608e 2023-03-11 22:53:34,458 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithWeeklyPolicy/7a35b3ad186d84bd239e22f355d22d96/.tmp/family1/76a666e886994e81bf7097172f0f608e as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithWeeklyPolicy/7a35b3ad186d84bd239e22f355d22d96/family1/76a666e886994e81bf7097172f0f608e 2023-03-11 22:53:34,465 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithWeeklyPolicy/7a35b3ad186d84bd239e22f355d22d96/family1/76a666e886994e81bf7097172f0f608e, entries=1, sequenceid=9, filesize=5.0 K 2023-03-11 22:53:34,466 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 7a35b3ad186d84bd239e22f355d22d96 in 847ms, sequenceid=9, compaction requested=false 2023-03-11 22:53:34,466 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7a35b3ad186d84bd239e22f355d22d96: 2023-03-11 22:53:34,466 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1678575211483.7a35b3ad186d84bd239e22f355d22d96. 2023-03-11 22:53:34,466 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 22:53:34,466 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 22:53:34,466 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:34,466 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-03-11 22:53:34,466 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-03-11 22:53:34,468 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:34,468 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:34,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:34,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:53:34,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:53:34,468 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:34,468 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 22:53:34,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:53:34,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:53:34,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:34,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:34,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:53:34,470 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-03-11 22:53:34,470 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@ed5f0a1[Count = 0] remaining members to acquire global barrier 2023-03-11 22:53:34,470 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-11 22:53:34,470 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:34,471 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:34,471 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:34,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:34,471 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-11 22:53:34,471 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-03-11 22:53:34,471 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,41843,1678575183185' in zk 2023-03-11 22:53:34,471 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:34,471 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 22:53:34,472 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:34,472 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-11 22:53:34,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:34,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:53:34,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:53:34,472 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:53:34,473 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-03-11 22:53:34,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:53:34,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:53:34,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:34,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:34,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:53:34,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:34,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:34,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,41843,1678575183185': 2023-03-11 22:53:34,476 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-11 22:53:34,476 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-03-11 22:53:34,476 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 22:53:34,476 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 22:53:34,476 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:34,476 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 22:53:34,479 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:34,479 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:34,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:34,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:53:34,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:53:34,479 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:34,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:34,479 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:53:34,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:53:34,480 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:53:34,480 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:34,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:53:34,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:34,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:34,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:53:34,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:34,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:34,481 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:34,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:53:34,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:34,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:34,488 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:34,488 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:34,488 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:34,488 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:34,488 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-03-11 22:53:34,488 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 22:53:34,488 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:53:34,488 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:53:34,488 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:53:34,488 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:34,488 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:53:34,489 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:34,489 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-11 22:53:34,489 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 22:53:34,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:53:34,489 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:34,490 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:53:34,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:53:34,589 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 22:53:34,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 22:53:34,600 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-11 22:53:34,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-11 22:53:34,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:34,603 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-03-11 22:53:34,603 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:53:34,603 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-11 22:53:34,603 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-11 22:53:34,604 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:34,604 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:34,605 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:34,605 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:53:34,606 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:53:34,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:53:34,606 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:34,606 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 22:53:34,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:34,607 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:34,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 22:53:34,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:34,608 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:34,609 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-03-11 22:53:34,609 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:34,609 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-11 22:53:34,609 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:53:34,609 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-11 22:53:34,609 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 22:53:34,609 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 22:53:34,609 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1678575211483.7a35b3ad186d84bd239e22f355d22d96. 2023-03-11 22:53:34,610 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1678575211483.7a35b3ad186d84bd239e22f355d22d96. started... 2023-03-11 22:53:34,610 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 7a35b3ad186d84bd239e22f355d22d96 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-11 22:53:35,039 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120181687f2b46044e55bb45c1f207a228ea to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015120181687f2b46044e55bb45c1f207a228ea 2023-03-11 22:53:35,045 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithWeeklyPolicy/7a35b3ad186d84bd239e22f355d22d96/.tmp/family1/cc1a8d6bb21845e8a222ec6b935e2cba 2023-03-11 22:53:35,052 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithWeeklyPolicy/7a35b3ad186d84bd239e22f355d22d96/.tmp/family1/cc1a8d6bb21845e8a222ec6b935e2cba as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithWeeklyPolicy/7a35b3ad186d84bd239e22f355d22d96/family1/cc1a8d6bb21845e8a222ec6b935e2cba 2023-03-11 22:53:35,059 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithWeeklyPolicy/7a35b3ad186d84bd239e22f355d22d96/family1/cc1a8d6bb21845e8a222ec6b935e2cba, entries=1, sequenceid=13, filesize=4.9 K 2023-03-11 22:53:35,060 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 7a35b3ad186d84bd239e22f355d22d96 in 450ms, sequenceid=13, compaction requested=true 2023-03-11 22:53:35,060 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7a35b3ad186d84bd239e22f355d22d96: 2023-03-11 22:53:35,060 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1678575211483.7a35b3ad186d84bd239e22f355d22d96. 2023-03-11 22:53:35,060 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 22:53:35,060 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 22:53:35,060 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:35,060 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-03-11 22:53:35,060 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-03-11 22:53:35,062 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:35,062 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:35,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:35,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:53:35,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:53:35,062 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:35,062 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 22:53:35,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:53:35,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:53:35,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:35,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:35,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:53:35,064 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-03-11 22:53:35,064 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@78df5d36[Count = 0] remaining members to acquire global barrier 2023-03-11 22:53:35,064 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-11 22:53:35,064 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:35,065 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:35,065 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:35,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:35,065 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-11 22:53:35,065 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-03-11 22:53:35,065 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:35,065 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 22:53:35,065 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,41843,1678575183185' in zk 2023-03-11 22:53:35,066 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:35,066 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-11 22:53:35,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:35,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:53:35,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:53:35,066 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:53:35,066 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-03-11 22:53:35,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:53:35,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:53:35,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:35,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:35,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:53:35,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:35,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:35,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,41843,1678575183185': 2023-03-11 22:53:35,068 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-11 22:53:35,068 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-03-11 22:53:35,068 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 22:53:35,068 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 22:53:35,068 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:35,069 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 22:53:35,070 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:35,070 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:35,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:35,071 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:35,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:53:35,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:53:35,071 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:53:35,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:35,071 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:35,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:53:35,071 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:53:35,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:53:35,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:35,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:35,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:53:35,072 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:35,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:35,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:35,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:53:35,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:35,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:35,074 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:35,074 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:35,074 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:53:35,074 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:53:35,074 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:53:35,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:53:35,074 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:53:35,074 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-03-11 22:53:35,074 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 22:53:35,074 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:35,074 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-11 22:53:35,074 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:53:35,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:53:35,074 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:35,074 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-11 22:53:35,075 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:35,075 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 22:53:35,075 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:35,075 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:35,175 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 22:53:35,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 22:53:35,186 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-11 22:53:35,188 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-11 22:53:35,188 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:35,189 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-03-11 22:53:35,189 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:53:35,189 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-11 22:53:35,189 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-11 22:53:35,189 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:35,189 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:35,191 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:53:35,191 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:35,191 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:53:35,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:53:35,191 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:35,191 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 22:53:35,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:35,192 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:35,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 22:53:35,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:35,193 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:35,193 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-03-11 22:53:35,193 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:35,193 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-11 22:53:35,193 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:53:35,193 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-11 22:53:35,193 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 22:53:35,193 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 22:53:35,193 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1678575211483.7a35b3ad186d84bd239e22f355d22d96. 2023-03-11 22:53:35,194 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1678575211483.7a35b3ad186d84bd239e22f355d22d96. started... 2023-03-11 22:53:35,194 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 7a35b3ad186d84bd239e22f355d22d96 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-11 22:53:35,613 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120512e60283480a48519bdc77251cf7eb71 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015120512e60283480a48519bdc77251cf7eb71 2023-03-11 22:53:36,022 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithWeeklyPolicy/7a35b3ad186d84bd239e22f355d22d96/.tmp/family1/e4cd5d1de6434cea8b494513aae5bcaf 2023-03-11 22:53:36,035 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithWeeklyPolicy/7a35b3ad186d84bd239e22f355d22d96/.tmp/family1/e4cd5d1de6434cea8b494513aae5bcaf as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithWeeklyPolicy/7a35b3ad186d84bd239e22f355d22d96/family1/e4cd5d1de6434cea8b494513aae5bcaf 2023-03-11 22:53:36,041 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithWeeklyPolicy/7a35b3ad186d84bd239e22f355d22d96/family1/e4cd5d1de6434cea8b494513aae5bcaf, entries=1, sequenceid=17, filesize=4.9 K 2023-03-11 22:53:36,042 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 7a35b3ad186d84bd239e22f355d22d96 in 848ms, sequenceid=17, compaction requested=true 2023-03-11 22:53:36,043 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7a35b3ad186d84bd239e22f355d22d96: 2023-03-11 22:53:36,043 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1678575211483.7a35b3ad186d84bd239e22f355d22d96. 2023-03-11 22:53:36,043 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 22:53:36,043 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 22:53:36,043 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:36,043 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-03-11 22:53:36,043 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-03-11 22:53:36,044 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:36,044 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:36,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:36,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:53:36,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:53:36,045 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:36,045 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 22:53:36,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:53:36,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:53:36,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:36,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:36,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:53:36,047 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-03-11 22:53:36,047 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@661a7b60[Count = 0] remaining members to acquire global barrier 2023-03-11 22:53:36,047 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-11 22:53:36,048 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:36,048 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:36,048 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:36,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:36,049 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-11 22:53:36,049 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-03-11 22:53:36,049 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,41843,1678575183185' in zk 2023-03-11 22:53:36,049 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:36,049 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 22:53:36,050 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-11 22:53:36,050 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:36,050 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:53:36,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:36,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:53:36,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:53:36,050 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-03-11 22:53:36,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:53:36,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:53:36,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:36,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:36,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:53:36,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:36,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:36,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,41843,1678575183185': 2023-03-11 22:53:36,053 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-11 22:53:36,053 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-03-11 22:53:36,053 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 22:53:36,053 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 22:53:36,053 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:36,053 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 22:53:36,063 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:36,063 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:36,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:36,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:53:36,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:53:36,063 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:36,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:36,063 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:53:36,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:53:36,064 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:53:36,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:53:36,064 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:36,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:36,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:36,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:53:36,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:36,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:36,066 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:36,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:53:36,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:36,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:36,071 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:36,071 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:53:36,071 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:36,072 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:36,072 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:36,072 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:36,072 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:36,072 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:36,071 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:53:36,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:53:36,071 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:53:36,072 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-03-11 22:53:36,072 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 22:53:36,072 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:53:36,072 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:53:36,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:53:36,072 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-11 22:53:36,073 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 22:53:36,173 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 22:53:36,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 22:53:36,186 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-11 22:53:36,188 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-11 22:53:36,188 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:36,188 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-03-11 22:53:36,188 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:53:36,189 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-11 22:53:36,189 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-11 22:53:36,189 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:36,190 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:36,191 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:53:36,191 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:36,191 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:53:36,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:53:36,192 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:36,192 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 22:53:36,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:36,192 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:36,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 22:53:36,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:36,193 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:36,193 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-03-11 22:53:36,193 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:36,194 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-11 22:53:36,194 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:53:36,194 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-11 22:53:36,194 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 22:53:36,194 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 22:53:36,194 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1678575211483.7a35b3ad186d84bd239e22f355d22d96. 2023-03-11 22:53:36,194 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1678575211483.7a35b3ad186d84bd239e22f355d22d96. started... 2023-03-11 22:53:36,194 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 7a35b3ad186d84bd239e22f355d22d96 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-11 22:53:36,619 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228552c98e5b2424e248f7e436691bdd3a5 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151228552c98e5b2424e248f7e436691bdd3a5 2023-03-11 22:53:37,027 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithWeeklyPolicy/7a35b3ad186d84bd239e22f355d22d96/.tmp/family1/2394e1bede7d4fe7bd38886d2442aeb1 2023-03-11 22:53:37,039 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithWeeklyPolicy/7a35b3ad186d84bd239e22f355d22d96/.tmp/family1/2394e1bede7d4fe7bd38886d2442aeb1 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithWeeklyPolicy/7a35b3ad186d84bd239e22f355d22d96/family1/2394e1bede7d4fe7bd38886d2442aeb1 2023-03-11 22:53:37,045 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithWeeklyPolicy/7a35b3ad186d84bd239e22f355d22d96/family1/2394e1bede7d4fe7bd38886d2442aeb1, entries=1, sequenceid=21, filesize=4.9 K 2023-03-11 22:53:37,047 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 7a35b3ad186d84bd239e22f355d22d96 in 853ms, sequenceid=21, compaction requested=true 2023-03-11 22:53:37,047 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7a35b3ad186d84bd239e22f355d22d96: 2023-03-11 22:53:37,047 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1678575211483.7a35b3ad186d84bd239e22f355d22d96. 2023-03-11 22:53:37,047 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 22:53:37,047 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 22:53:37,047 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:37,047 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-03-11 22:53:37,047 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-03-11 22:53:37,049 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:37,049 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:37,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:37,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:53:37,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:53:37,050 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:37,050 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 22:53:37,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:53:37,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:53:37,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:37,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:37,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:53:37,053 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-03-11 22:53:37,053 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@19c3e730[Count = 0] remaining members to acquire global barrier 2023-03-11 22:53:37,053 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-11 22:53:37,053 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:37,071 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:37,071 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:37,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:37,072 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-11 22:53:37,072 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-03-11 22:53:37,072 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,41843,1678575183185' in zk 2023-03-11 22:53:37,072 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:37,072 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 22:53:37,073 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:37,073 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-11 22:53:37,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:37,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:53:37,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:53:37,073 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:53:37,074 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-03-11 22:53:37,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:53:37,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:53:37,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:37,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:37,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:53:37,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:37,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:37,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,41843,1678575183185': 2023-03-11 22:53:37,077 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-11 22:53:37,077 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-03-11 22:53:37,077 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 22:53:37,077 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 22:53:37,077 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:37,077 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 22:53:37,079 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:37,079 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:53:37,079 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:37,079 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:37,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:37,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:37,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:53:37,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:53:37,079 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:53:37,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:53:37,079 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:37,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:53:37,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:37,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:37,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:53:37,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:37,081 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:37,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:37,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:53:37,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:37,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:37,084 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:37,084 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:37,084 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:53:37,084 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:37,084 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-03-11 22:53:37,085 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-11 22:53:37,084 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:53:37,084 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:53:37,084 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:53:37,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:53:37,085 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 22:53:37,084 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:37,085 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:37,085 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:37,085 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:37,086 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-11 22:53:37,086 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:53:37,086 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 22:53:37,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:53:37,186 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 22:53:37,188 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 22:53:37,196 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-11 22:53:37,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-11 22:53:37,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:37,199 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-03-11 22:53:37,199 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:53:37,199 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-11 22:53:37,199 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-11 22:53:37,200 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:37,200 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:37,201 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:53:37,201 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:37,201 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:53:37,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:53:37,202 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:37,202 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 22:53:37,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:37,202 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:37,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 22:53:37,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:37,203 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:37,203 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-03-11 22:53:37,203 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:37,204 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-11 22:53:37,204 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:53:37,204 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-11 22:53:37,204 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 22:53:37,204 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 22:53:37,204 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1678575211483.7a35b3ad186d84bd239e22f355d22d96. 2023-03-11 22:53:37,204 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1678575211483.7a35b3ad186d84bd239e22f355d22d96. started... 2023-03-11 22:53:37,204 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 7a35b3ad186d84bd239e22f355d22d96 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-11 22:53:37,631 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231b4a08658900c4960b24a1035f2b2db9d to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151231b4a08658900c4960b24a1035f2b2db9d 2023-03-11 22:53:37,818 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-11 22:53:38,039 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithWeeklyPolicy/7a35b3ad186d84bd239e22f355d22d96/.tmp/family1/8accc349dfeb466eba39f387109bf799 2023-03-11 22:53:38,053 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithWeeklyPolicy/7a35b3ad186d84bd239e22f355d22d96/.tmp/family1/8accc349dfeb466eba39f387109bf799 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithWeeklyPolicy/7a35b3ad186d84bd239e22f355d22d96/family1/8accc349dfeb466eba39f387109bf799 2023-03-11 22:53:38,059 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithWeeklyPolicy/7a35b3ad186d84bd239e22f355d22d96/family1/8accc349dfeb466eba39f387109bf799, entries=1, sequenceid=25, filesize=4.9 K 2023-03-11 22:53:38,059 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 7a35b3ad186d84bd239e22f355d22d96 in 855ms, sequenceid=25, compaction requested=true 2023-03-11 22:53:38,060 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7a35b3ad186d84bd239e22f355d22d96: 2023-03-11 22:53:38,060 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1678575211483.7a35b3ad186d84bd239e22f355d22d96. 2023-03-11 22:53:38,060 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 22:53:38,060 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 22:53:38,060 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:38,060 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-03-11 22:53:38,060 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-03-11 22:53:38,061 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:38,061 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:38,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:38,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:53:38,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:53:38,061 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:38,061 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 22:53:38,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:53:38,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:53:38,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:38,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:38,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:53:38,063 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-03-11 22:53:38,063 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@38324c51[Count = 0] remaining members to acquire global barrier 2023-03-11 22:53:38,063 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-11 22:53:38,063 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:38,064 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:38,064 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:38,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:38,064 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-11 22:53:38,064 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-03-11 22:53:38,064 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:38,064 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 22:53:38,064 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,41843,1678575183185' in zk 2023-03-11 22:53:38,065 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:38,065 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-11 22:53:38,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:38,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:53:38,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:53:38,066 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:53:38,066 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-03-11 22:53:38,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:53:38,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:53:38,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:38,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:38,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:53:38,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:38,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:38,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,41843,1678575183185': 2023-03-11 22:53:38,068 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-11 22:53:38,068 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-03-11 22:53:38,068 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 22:53:38,068 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 22:53:38,068 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:38,068 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 22:53:38,069 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:38,069 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:53:38,069 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:38,069 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:38,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:38,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:38,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:53:38,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:53:38,069 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:53:38,069 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:38,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:53:38,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:53:38,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:38,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:38,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:53:38,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:38,070 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:38,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:38,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:53:38,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:38,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:38,071 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:38,071 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:53:38,071 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:38,071 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:53:38,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:53:38,071 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:53:38,071 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-11 22:53:38,071 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-03-11 22:53:38,072 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 22:53:38,071 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:53:38,071 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:38,072 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:53:38,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:53:38,072 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:38,072 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-11 22:53:38,072 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:38,072 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 22:53:38,072 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:38,072 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:38,172 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 22:53:38,173 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 22:53:38,177 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-11 22:53:38,179 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-11 22:53:38,179 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:38,179 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-03-11 22:53:38,179 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:53:38,179 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-11 22:53:38,179 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-11 22:53:38,180 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:38,180 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:38,181 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:53:38,181 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:38,181 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:53:38,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:53:38,181 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:38,181 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 22:53:38,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:38,182 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:38,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 22:53:38,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:38,182 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:38,182 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-03-11 22:53:38,183 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:38,183 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-11 22:53:38,183 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:53:38,183 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-11 22:53:38,183 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 22:53:38,183 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 22:53:38,183 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1678575211483.7a35b3ad186d84bd239e22f355d22d96. 2023-03-11 22:53:38,183 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1678575211483.7a35b3ad186d84bd239e22f355d22d96. started... 2023-03-11 22:53:38,183 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 7a35b3ad186d84bd239e22f355d22d96 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-11 22:53:38,608 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101f9e392a22fd74e3a90ab6077a6dc66ac to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160101f9e392a22fd74e3a90ab6077a6dc66ac 2023-03-11 22:53:39,016 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithWeeklyPolicy/7a35b3ad186d84bd239e22f355d22d96/.tmp/family1/9ec45af514c74f4f8f0e81c18bf85c03 2023-03-11 22:53:39,028 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithWeeklyPolicy/7a35b3ad186d84bd239e22f355d22d96/.tmp/family1/9ec45af514c74f4f8f0e81c18bf85c03 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithWeeklyPolicy/7a35b3ad186d84bd239e22f355d22d96/family1/9ec45af514c74f4f8f0e81c18bf85c03 2023-03-11 22:53:39,036 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithWeeklyPolicy/7a35b3ad186d84bd239e22f355d22d96/family1/9ec45af514c74f4f8f0e81c18bf85c03, entries=1, sequenceid=29, filesize=4.9 K 2023-03-11 22:53:39,037 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 7a35b3ad186d84bd239e22f355d22d96 in 854ms, sequenceid=29, compaction requested=true 2023-03-11 22:53:39,037 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7a35b3ad186d84bd239e22f355d22d96: 2023-03-11 22:53:39,037 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1678575211483.7a35b3ad186d84bd239e22f355d22d96. 2023-03-11 22:53:39,037 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 22:53:39,037 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 22:53:39,037 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:39,037 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-03-11 22:53:39,037 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-03-11 22:53:39,039 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:39,039 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:39,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:39,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:53:39,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:53:39,039 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:39,039 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 22:53:39,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:53:39,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:53:39,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:39,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:39,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:53:39,042 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-03-11 22:53:39,042 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3a06808c[Count = 0] remaining members to acquire global barrier 2023-03-11 22:53:39,042 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-11 22:53:39,042 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:39,043 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:39,043 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:39,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:39,043 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-11 22:53:39,043 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-03-11 22:53:39,043 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:39,043 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 22:53:39,043 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,41843,1678575183185' in zk 2023-03-11 22:53:39,044 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:39,044 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-11 22:53:39,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:39,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:53:39,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:53:39,044 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:53:39,045 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-03-11 22:53:39,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:53:39,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:53:39,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:39,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:39,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:53:39,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:39,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:39,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,41843,1678575183185': 2023-03-11 22:53:39,047 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-11 22:53:39,047 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-03-11 22:53:39,047 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 22:53:39,047 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 22:53:39,047 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:39,048 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 22:53:39,049 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:39,049 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:53:39,049 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:39,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:39,049 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:39,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:39,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:53:39,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:53:39,049 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:53:39,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:53:39,049 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:39,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:53:39,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:39,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:39,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:53:39,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:39,051 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:39,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:39,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:53:39,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:39,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:39,053 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:39,053 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:53:39,053 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:39,053 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-03-11 22:53:39,053 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 22:53:39,053 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:53:39,053 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:53:39,053 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-11 22:53:39,053 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:53:39,054 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-11 22:53:39,054 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 22:53:39,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:53:39,053 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:39,054 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:39,054 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:39,054 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:39,054 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:39,054 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:53:39,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:53:39,154 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 22:53:39,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 22:53:39,165 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-11 22:53:39,167 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-11 22:53:39,167 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:39,168 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-03-11 22:53:39,168 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:53:39,168 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-11 22:53:39,168 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-11 22:53:39,168 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:39,168 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:39,170 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:39,170 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:53:39,170 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:53:39,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:53:39,170 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:39,170 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 22:53:39,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:39,171 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:39,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 22:53:39,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:39,171 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:39,171 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-03-11 22:53:39,172 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:39,172 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-11 22:53:39,172 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:53:39,172 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-11 22:53:39,172 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 22:53:39,172 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 22:53:39,172 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1678575211483.7a35b3ad186d84bd239e22f355d22d96. 2023-03-11 22:53:39,172 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1678575211483.7a35b3ad186d84bd239e22f355d22d96. started... 2023-03-11 22:53:39,172 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 7a35b3ad186d84bd239e22f355d22d96 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-11 22:53:39,591 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601036b134c43722d4c51b9b6c6e87addc566 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601036b134c43722d4c51b9b6c6e87addc566 2023-03-11 22:53:39,997 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithWeeklyPolicy/7a35b3ad186d84bd239e22f355d22d96/.tmp/family1/87a156182c6f4c6eb28a496356d1e281 2023-03-11 22:53:40,010 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithWeeklyPolicy/7a35b3ad186d84bd239e22f355d22d96/.tmp/family1/87a156182c6f4c6eb28a496356d1e281 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithWeeklyPolicy/7a35b3ad186d84bd239e22f355d22d96/family1/87a156182c6f4c6eb28a496356d1e281 2023-03-11 22:53:40,015 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithWeeklyPolicy/7a35b3ad186d84bd239e22f355d22d96/family1/87a156182c6f4c6eb28a496356d1e281, entries=1, sequenceid=33, filesize=4.9 K 2023-03-11 22:53:40,016 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 7a35b3ad186d84bd239e22f355d22d96 in 844ms, sequenceid=33, compaction requested=true 2023-03-11 22:53:40,016 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7a35b3ad186d84bd239e22f355d22d96: 2023-03-11 22:53:40,016 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1678575211483.7a35b3ad186d84bd239e22f355d22d96. 2023-03-11 22:53:40,016 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 22:53:40,016 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 22:53:40,016 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:40,016 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-03-11 22:53:40,016 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-03-11 22:53:40,017 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:40,017 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:40,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:40,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:53:40,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:53:40,017 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:40,017 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 22:53:40,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:53:40,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:53:40,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:40,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:40,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:53:40,019 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-03-11 22:53:40,019 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@ff22dd7[Count = 0] remaining members to acquire global barrier 2023-03-11 22:53:40,019 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-11 22:53:40,019 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:40,019 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:40,019 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:40,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:40,020 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-11 22:53:40,020 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-03-11 22:53:40,020 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,41843,1678575183185' in zk 2023-03-11 22:53:40,020 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:40,020 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 22:53:40,020 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:40,020 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-11 22:53:40,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:40,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:53:40,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:53:40,021 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:53:40,021 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-03-11 22:53:40,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:53:40,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:53:40,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:40,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:40,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:53:40,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:40,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:40,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,41843,1678575183185': 2023-03-11 22:53:40,023 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-11 22:53:40,023 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-03-11 22:53:40,023 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 22:53:40,023 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 22:53:40,023 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:40,023 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 22:53:40,024 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:40,024 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:40,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:40,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:53:40,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:53:40,024 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:40,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:40,024 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:53:40,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:53:40,025 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:40,025 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:53:40,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:53:40,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:40,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:40,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:53:40,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:40,026 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:40,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:40,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:53:40,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:40,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:40,028 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:40,028 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:40,028 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:40,028 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:53:40,028 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-11 22:53:40,028 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:53:40,028 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:40,028 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-03-11 22:53:40,029 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 22:53:40,028 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:40,028 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:53:40,028 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:53:40,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:53:40,029 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-11 22:53:40,029 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 22:53:40,029 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:40,029 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:40,029 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:53:40,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:53:40,129 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 22:53:40,131 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 22:53:40,141 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-11 22:53:40,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-11 22:53:40,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:40,143 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-03-11 22:53:40,143 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:53:40,143 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-11 22:53:40,143 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-11 22:53:40,144 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:40,144 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:40,145 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:40,145 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:53:40,145 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:53:40,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:53:40,146 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:40,146 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 22:53:40,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:40,146 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:40,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 22:53:40,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:40,147 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:40,147 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-03-11 22:53:40,147 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:40,147 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-11 22:53:40,147 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:53:40,147 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-11 22:53:40,148 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 22:53:40,148 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 22:53:40,148 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1678575211483.7a35b3ad186d84bd239e22f355d22d96. 2023-03-11 22:53:40,148 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1678575211483.7a35b3ad186d84bd239e22f355d22d96. started... 2023-03-11 22:53:40,148 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 7a35b3ad186d84bd239e22f355d22d96 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-11 22:53:40,561 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015090727ea6121d43b47c6a3bfd681c8a6837c to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015090727ea6121d43b47c6a3bfd681c8a6837c 2023-03-11 22:53:40,567 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithWeeklyPolicy/7a35b3ad186d84bd239e22f355d22d96/.tmp/family1/8bfa0eeaf5524f16a4a8e30cba660bd0 2023-03-11 22:53:40,572 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithWeeklyPolicy/7a35b3ad186d84bd239e22f355d22d96/.tmp/family1/8bfa0eeaf5524f16a4a8e30cba660bd0 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithWeeklyPolicy/7a35b3ad186d84bd239e22f355d22d96/family1/8bfa0eeaf5524f16a4a8e30cba660bd0 2023-03-11 22:53:40,579 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithWeeklyPolicy/7a35b3ad186d84bd239e22f355d22d96/family1/8bfa0eeaf5524f16a4a8e30cba660bd0, entries=1, sequenceid=37, filesize=4.9 K 2023-03-11 22:53:40,580 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 7a35b3ad186d84bd239e22f355d22d96 in 432ms, sequenceid=37, compaction requested=true 2023-03-11 22:53:40,580 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7a35b3ad186d84bd239e22f355d22d96: 2023-03-11 22:53:40,580 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1678575211483.7a35b3ad186d84bd239e22f355d22d96. 2023-03-11 22:53:40,580 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 22:53:40,580 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 22:53:40,580 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:40,580 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-03-11 22:53:40,580 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-03-11 22:53:40,582 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:40,582 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:40,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:40,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:53:40,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:53:40,583 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:40,583 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 22:53:40,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:53:40,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:53:40,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:40,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:40,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:53:40,584 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-03-11 22:53:40,584 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-11 22:53:40,584 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@90ea17e[Count = 0] remaining members to acquire global barrier 2023-03-11 22:53:40,584 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:40,585 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:40,585 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:40,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:40,585 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-11 22:53:40,585 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-03-11 22:53:40,585 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:40,585 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 22:53:40,585 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,41843,1678575183185' in zk 2023-03-11 22:53:40,586 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:40,586 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-11 22:53:40,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:40,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:53:40,586 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:53:40,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:53:40,587 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-03-11 22:53:40,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:53:40,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:53:40,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:40,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:40,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:53:40,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:40,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:40,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,41843,1678575183185': 2023-03-11 22:53:40,589 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-11 22:53:40,589 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-03-11 22:53:40,589 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 22:53:40,589 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 22:53:40,589 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:40,589 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 22:53:40,590 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:40,590 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:53:40,590 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:40,590 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:40,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:40,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:40,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:53:40,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:53:40,591 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:40,591 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:53:40,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:53:40,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:53:40,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:40,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:40,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:53:40,592 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:40,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:40,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:40,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:53:40,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:40,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:40,593 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:40,593 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:40,593 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:40,593 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:40,593 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:40,593 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:53:40,593 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-03-11 22:53:40,593 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:40,593 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 22:53:40,593 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:53:40,593 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:40,593 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-11 22:53:40,593 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:53:40,593 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:53:40,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:53:40,593 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-11 22:53:40,594 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 22:53:40,594 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:53:40,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:53:40,694 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 22:53:40,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 22:53:40,703 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-11 22:53:40,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-11 22:53:40,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:40,706 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-03-11 22:53:40,706 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:53:40,706 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-11 22:53:40,706 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-11 22:53:40,707 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:40,707 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:40,709 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:53:40,709 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:40,709 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:53:40,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:53:40,710 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:40,710 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 22:53:40,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:40,711 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:40,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 22:53:40,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:40,712 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:40,712 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-03-11 22:53:40,712 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:40,712 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-11 22:53:40,713 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:53:40,713 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-11 22:53:40,713 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 22:53:40,713 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 22:53:40,713 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1678575211483.7a35b3ad186d84bd239e22f355d22d96. 2023-03-11 22:53:40,713 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1678575211483.7a35b3ad186d84bd239e22f355d22d96. started... 2023-03-11 22:53:40,713 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 7a35b3ad186d84bd239e22f355d22d96 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-11 22:53:41,131 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511204d106e0fda80411c99625d0468b21101 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201511204d106e0fda80411c99625d0468b21101 2023-03-11 22:53:41,538 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithWeeklyPolicy/7a35b3ad186d84bd239e22f355d22d96/.tmp/family1/02fd650251ab4c72a5faf1caf41a0b7c 2023-03-11 22:53:41,547 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithWeeklyPolicy/7a35b3ad186d84bd239e22f355d22d96/.tmp/family1/02fd650251ab4c72a5faf1caf41a0b7c as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithWeeklyPolicy/7a35b3ad186d84bd239e22f355d22d96/family1/02fd650251ab4c72a5faf1caf41a0b7c 2023-03-11 22:53:41,555 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithWeeklyPolicy/7a35b3ad186d84bd239e22f355d22d96/family1/02fd650251ab4c72a5faf1caf41a0b7c, entries=1, sequenceid=41, filesize=4.9 K 2023-03-11 22:53:41,556 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 7a35b3ad186d84bd239e22f355d22d96 in 843ms, sequenceid=41, compaction requested=true 2023-03-11 22:53:41,556 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7a35b3ad186d84bd239e22f355d22d96: 2023-03-11 22:53:41,556 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1678575211483.7a35b3ad186d84bd239e22f355d22d96. 2023-03-11 22:53:41,556 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 22:53:41,556 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 22:53:41,556 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:41,556 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-03-11 22:53:41,556 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-03-11 22:53:41,558 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:41,558 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:41,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:41,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:53:41,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:53:41,558 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:41,558 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 22:53:41,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:53:41,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:53:41,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:41,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:41,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:53:41,560 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-03-11 22:53:41,560 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@237424ca[Count = 0] remaining members to acquire global barrier 2023-03-11 22:53:41,560 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-11 22:53:41,560 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:41,561 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:41,561 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:41,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:41,561 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-11 22:53:41,561 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-03-11 22:53:41,561 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,41843,1678575183185' in zk 2023-03-11 22:53:41,561 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:41,561 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 22:53:41,562 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-11 22:53:41,563 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:53:41,563 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-03-11 22:53:41,562 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:41,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:41,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:53:41,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:53:41,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:53:41,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:53:41,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:41,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:41,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:53:41,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:41,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:41,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,41843,1678575183185': 2023-03-11 22:53:41,566 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-11 22:53:41,566 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-03-11 22:53:41,566 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 22:53:41,566 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 22:53:41,566 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:41,566 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 22:53:41,579 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:41,579 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:41,579 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:41,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:41,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:53:41,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:53:41,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:41,579 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:53:41,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:53:41,580 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:53:41,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:53:41,580 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:41,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:41,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:41,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:53:41,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:41,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:41,580 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:41,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:53:41,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:41,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:41,588 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:41,588 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:53:41,588 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:41,588 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:53:41,588 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-11 22:53:41,588 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:41,588 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:41,588 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:41,588 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:41,588 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:41,588 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-03-11 22:53:41,588 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 22:53:41,588 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:53:41,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:53:41,588 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:53:41,589 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-11 22:53:41,589 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 22:53:41,589 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:53:41,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:53:41,689 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 22:53:41,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 22:53:41,693 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=44347] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMinorCompactionWithWeeklyPolicy 2023-03-11 22:53:41,696 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-03-11 22:53:41,697 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=26, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-03-11 22:53:41,699 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=26, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1678575821699 2023-03-11 22:53:41,699 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] mob.MobUtils(833): start MOB compaction of files for table='testMinorCompactionWithWeeklyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-11 22:53:41,701 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-03-11 22:53:41,702 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] compactions.PartitionedMobCompactor(306): The compaction type is PART_FILES, the request has 0 del files, 9 selected files, and 0 irrelevant files table 'testMinorCompactionWithWeeklyPolicy' and column 'family1' 2023-03-11 22:53:41,702 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-03-11 22:53:41,703 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] zookeeper.ReadOnlyZKClient(139): Connect 0x6354346e to 127.0.0.1:51815 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-11 22:53:41,707 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@62aa46ac, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-11 22:53:41,707 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-03-11 22:53:42,560 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103c06c75a34d9142b6b112cd154abcea47 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160103c06c75a34d9142b6b112cd154abcea47 2023-03-11 22:53:42,562 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-03-11 22:53:42,577 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-11 22:53:42,578 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:39264, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-11 22:53:42,585 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-11 22:53:42,587 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:33342, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-11 22:53:42,596 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/05d7f9e890514d3a8a64605a33918e0a first=Optional[r3] last=Optional[r6] 2023-03-11 22:53:42,596 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMinorCompactionWithWeeklyPolicy,,1678575211483.7a35b3ad186d84bd239e22f355d22d96., hostname=jenkins-hbase20.apache.org,41843,1678575183185, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/05d7f9e890514d3a8a64605a33918e0a}] 2023-03-11 22:53:42,601 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/05d7f9e890514d3a8a64605a33918e0a for inclusion in 7a35b3ad186d84bd239e22f355d22d96/family1 2023-03-11 22:53:42,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-03-11 22:53:42,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(777): Region bounds: first= last= 2023-03-11 22:53:42,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HRegion(2446): Flush status journal for 7a35b3ad186d84bd239e22f355d22d96: 2023-03-11 22:53:42,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/05d7f9e890514d3a8a64605a33918e0a to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testMinorCompactionWithWeeklyPolicy__r2t38rkifqlvcofoh9r0f1ablalqc2f2udo0pndk8dgjc24b70rrkbpqrar3pcsh/family1/05d7f9e890514d3a8a64605a33918e0a 2023-03-11 22:53:42,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testMinorCompactionWithWeeklyPolicy__r2t38rkifqlvcofoh9r0f1ablalqc2f2udo0pndk8dgjc24b70rrkbpqrar3pcsh/family1/05d7f9e890514d3a8a64605a33918e0a as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithWeeklyPolicy/7a35b3ad186d84bd239e22f355d22d96/family1/67f5d616f2fe48908a4a58361a1b4ba3_SeqId_44_ 2023-03-11 22:53:42,608 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testMinorCompactionWithWeeklyPolicy__r2t38rkifqlvcofoh9r0f1ablalqc2f2udo0pndk8dgjc24b70rrkbpqrar3pcsh/family1/05d7f9e890514d3a8a64605a33918e0a into 7a35b3ad186d84bd239e22f355d22d96/family1 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithWeeklyPolicy/7a35b3ad186d84bd239e22f355d22d96/family1/67f5d616f2fe48908a4a58361a1b4ba3_SeqId_44_ - updating store file list. 2023-03-11 22:53:42,612 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithWeeklyPolicy/7a35b3ad186d84bd239e22f355d22d96/family1/67f5d616f2fe48908a4a58361a1b4ba3_SeqId_44_ into 7a35b3ad186d84bd239e22f355d22d96/family1 2023-03-11 22:53:42,612 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testMinorCompactionWithWeeklyPolicy__r2t38rkifqlvcofoh9r0f1ablalqc2f2udo0pndk8dgjc24b70rrkbpqrar3pcsh/family1/05d7f9e890514d3a8a64605a33918e0a into 7a35b3ad186d84bd239e22f355d22d96/family1 (new location: hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithWeeklyPolicy/7a35b3ad186d84bd239e22f355d22d96/family1/67f5d616f2fe48908a4a58361a1b4ba3_SeqId_44_) 2023-03-11 22:53:42,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testMinorCompactionWithWeeklyPolicy__r2t38rkifqlvcofoh9r0f1ablalqc2f2udo0pndk8dgjc24b70rrkbpqrar3pcsh/family1/05d7f9e890514d3a8a64605a33918e0a 2023-03-11 22:53:42,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-03-11 22:53:42,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51214 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-03-11 22:53:42,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(1912): 7a35b3ad186d84bd239e22f355d22d96/family1 is initiating minor compaction 2023-03-11 22:53:42,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@64f0c55; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-03-11 22:53:42,616 INFO [RS:0;jenkins-hbase20:41843-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 7a35b3ad186d84bd239e22f355d22d96/family1 in testMinorCompactionWithWeeklyPolicy,,1678575211483.7a35b3ad186d84bd239e22f355d22d96. 2023-03-11 22:53:42,617 INFO [RS:0;jenkins-hbase20:41843-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithWeeklyPolicy/7a35b3ad186d84bd239e22f355d22d96/family1/76a666e886994e81bf7097172f0f608e, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithWeeklyPolicy/7a35b3ad186d84bd239e22f355d22d96/family1/cc1a8d6bb21845e8a222ec6b935e2cba, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithWeeklyPolicy/7a35b3ad186d84bd239e22f355d22d96/family1/e4cd5d1de6434cea8b494513aae5bcaf, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithWeeklyPolicy/7a35b3ad186d84bd239e22f355d22d96/family1/2394e1bede7d4fe7bd38886d2442aeb1, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithWeeklyPolicy/7a35b3ad186d84bd239e22f355d22d96/family1/8accc349dfeb466eba39f387109bf799, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithWeeklyPolicy/7a35b3ad186d84bd239e22f355d22d96/family1/9ec45af514c74f4f8f0e81c18bf85c03, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithWeeklyPolicy/7a35b3ad186d84bd239e22f355d22d96/family1/87a156182c6f4c6eb28a496356d1e281, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithWeeklyPolicy/7a35b3ad186d84bd239e22f355d22d96/family1/8bfa0eeaf5524f16a4a8e30cba660bd0, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithWeeklyPolicy/7a35b3ad186d84bd239e22f355d22d96/family1/02fd650251ab4c72a5faf1caf41a0b7c, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithWeeklyPolicy/7a35b3ad186d84bd239e22f355d22d96/family1/67f5d616f2fe48908a4a58361a1b4ba3_SeqId_44_] into tmpdir=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithWeeklyPolicy/7a35b3ad186d84bd239e22f355d22d96/.tmp, totalSize=50.0 K 2023-03-11 22:53:42,617 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] compactions.Compactor(207): Compacting 76a666e886994e81bf7097172f0f608e, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-03-11 22:53:42,617 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] compactions.Compactor(207): Compacting cc1a8d6bb21845e8a222ec6b935e2cba, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-03-11 22:53:42,617 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] compactions.Compactor(207): Compacting e4cd5d1de6434cea8b494513aae5bcaf, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-03-11 22:53:42,617 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] compactions.Compactor(207): Compacting 2394e1bede7d4fe7bd38886d2442aeb1, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-03-11 22:53:42,617 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] compactions.Compactor(207): Compacting 8accc349dfeb466eba39f387109bf799, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-03-11 22:53:42,617 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] compactions.Compactor(207): Compacting 9ec45af514c74f4f8f0e81c18bf85c03, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-03-11 22:53:42,617 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] compactions.Compactor(207): Compacting 87a156182c6f4c6eb28a496356d1e281, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-03-11 22:53:42,617 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] compactions.Compactor(207): Compacting 8bfa0eeaf5524f16a4a8e30cba660bd0, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-03-11 22:53:42,617 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] compactions.Compactor(207): Compacting 02fd650251ab4c72a5faf1caf41a0b7c, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-03-11 22:53:42,618 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] compactions.Compactor(207): Compacting 67f5d616f2fe48908a4a58361a1b4ba3_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-03-11 22:53:42,619 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-03-11 22:53:42,620 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 22:53:42,621 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151228552c98e5b2424e248f7e436691bdd3a5 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151228552c98e5b2424e248f7e436691bdd3a5 2023-03-11 22:53:42,623 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151231b4a08658900c4960b24a1035f2b2db9d to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151231b4a08658900c4960b24a1035f2b2db9d 2023-03-11 22:53:42,623 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160101f9e392a22fd74e3a90ab6077a6dc66ac to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160101f9e392a22fd74e3a90ab6077a6dc66ac 2023-03-11 22:53:42,624 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601036b134c43722d4c51b9b6c6e87addc566 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601036b134c43722d4c51b9b6c6e87addc566 2023-03-11 22:53:42,624 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithWeeklyPolicy 4 expired mob files are deleted 2023-03-11 22:53:42,624 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-03-11 22:53:42,625 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-03-11 22:53:42,625 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-03-11 22:53:42,625 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-03-11 22:53:42,625 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-03-11 22:53:42,625 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-03-11 22:53:42,625 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-03-11 22:53:42,625 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-03-11 22:53:42,625 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-03-11 22:53:42,650 INFO [RS:0;jenkins-hbase20:41843-shortCompactions-0] throttle.PressureAwareThroughputController(145): 7a35b3ad186d84bd239e22f355d22d96#family1#compaction#34 average throughput is 0.27 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-11 22:53:43,476 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120532666fa27c7e4963b04f5272cfd63d88 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015120532666fa27c7e4963b04f5272cfd63d88 2023-03-11 22:53:43,478 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithWeeklyPolicy/7a35b3ad186d84bd239e22f355d22d96/.tmp/family1/3e47eb2650b74d45afb6b8778b4dc60b as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithWeeklyPolicy/7a35b3ad186d84bd239e22f355d22d96/family1/3e47eb2650b74d45afb6b8778b4dc60b 2023-03-11 22:53:43,478 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-03-11 22:53:43,483 INFO [RS:0;jenkins-hbase20:41843-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 7a35b3ad186d84bd239e22f355d22d96/family1 of 7a35b3ad186d84bd239e22f355d22d96 into 3e47eb2650b74d45afb6b8778b4dc60b(size=6.6 K), total size for store is 171.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-11 22:53:43,484 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 7a35b3ad186d84bd239e22f355d22d96: 2023-03-11 22:53:43,484 INFO [RS:0;jenkins-hbase20:41843-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithWeeklyPolicy,,1678575211483.7a35b3ad186d84bd239e22f355d22d96., storeName=family1, fileCount=10, fileSize=50.0 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.5 K), priority=2, time=1678575222616; duration=0sec 2023-03-11 22:53:43,484 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-11 22:53:43,501 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/7cc2a4a2de1348f5999b2eb87709813f first=Optional[r1] last=Optional[r2] 2023-03-11 22:53:43,501 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMinorCompactionWithWeeklyPolicy,,1678575211483.7a35b3ad186d84bd239e22f355d22d96., hostname=jenkins-hbase20.apache.org,41843,1678575183185, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/7cc2a4a2de1348f5999b2eb87709813f}] 2023-03-11 22:53:43,504 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/7cc2a4a2de1348f5999b2eb87709813f for inclusion in 7a35b3ad186d84bd239e22f355d22d96/family1 2023-03-11 22:53:43,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(775): HFile bounds: first=r1 last=r2 2023-03-11 22:53:43,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(777): Region bounds: first= last= 2023-03-11 22:53:43,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HRegion(2446): Flush status journal for 7a35b3ad186d84bd239e22f355d22d96: 2023-03-11 22:53:43,509 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/7cc2a4a2de1348f5999b2eb87709813f to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testMinorCompactionWithWeeklyPolicy__ptto10165bo6d7hihrt1ejpgb5ju9k3p8v6s1h91oivunuvbu11evbagqm1jcp64/family1/7cc2a4a2de1348f5999b2eb87709813f 2023-03-11 22:53:43,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testMinorCompactionWithWeeklyPolicy__ptto10165bo6d7hihrt1ejpgb5ju9k3p8v6s1h91oivunuvbu11evbagqm1jcp64/family1/7cc2a4a2de1348f5999b2eb87709813f as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithWeeklyPolicy/7a35b3ad186d84bd239e22f355d22d96/family1/201092c00b5243ecb95dec5fb696ec49_SeqId_47_ 2023-03-11 22:53:43,511 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testMinorCompactionWithWeeklyPolicy__ptto10165bo6d7hihrt1ejpgb5ju9k3p8v6s1h91oivunuvbu11evbagqm1jcp64/family1/7cc2a4a2de1348f5999b2eb87709813f into 7a35b3ad186d84bd239e22f355d22d96/family1 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithWeeklyPolicy/7a35b3ad186d84bd239e22f355d22d96/family1/201092c00b5243ecb95dec5fb696ec49_SeqId_47_ - updating store file list. 2023-03-11 22:53:43,515 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithWeeklyPolicy/7a35b3ad186d84bd239e22f355d22d96/family1/201092c00b5243ecb95dec5fb696ec49_SeqId_47_ into 7a35b3ad186d84bd239e22f355d22d96/family1 2023-03-11 22:53:43,515 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testMinorCompactionWithWeeklyPolicy__ptto10165bo6d7hihrt1ejpgb5ju9k3p8v6s1h91oivunuvbu11evbagqm1jcp64/family1/7cc2a4a2de1348f5999b2eb87709813f into 7a35b3ad186d84bd239e22f355d22d96/family1 (new location: hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithWeeklyPolicy/7a35b3ad186d84bd239e22f355d22d96/family1/201092c00b5243ecb95dec5fb696ec49_SeqId_47_) 2023-03-11 22:53:43,515 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testMinorCompactionWithWeeklyPolicy__ptto10165bo6d7hihrt1ejpgb5ju9k3p8v6s1h91oivunuvbu11evbagqm1jcp64/family1/7cc2a4a2de1348f5999b2eb87709813f 2023-03-11 22:53:43,516 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-03-11 22:53:43,516 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 181014 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-03-11 22:53:43,517 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(1912): 7a35b3ad186d84bd239e22f355d22d96/family1 is initiating minor compaction (all files) 2023-03-11 22:53:43,517 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@79a1491a; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-11 22:53:43,517 INFO [RS:0;jenkins-hbase20:41843-longCompactions-0] regionserver.HRegion(2259): Starting compaction of 7a35b3ad186d84bd239e22f355d22d96/family1 in testMinorCompactionWithWeeklyPolicy,,1678575211483.7a35b3ad186d84bd239e22f355d22d96. 2023-03-11 22:53:43,517 INFO [RS:0;jenkins-hbase20:41843-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithWeeklyPolicy/7a35b3ad186d84bd239e22f355d22d96/family1/3de38c94fd3b4535b71a065eb98ab2b1, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithWeeklyPolicy/7a35b3ad186d84bd239e22f355d22d96/family1/3e47eb2650b74d45afb6b8778b4dc60b, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithWeeklyPolicy/7a35b3ad186d84bd239e22f355d22d96/family1/201092c00b5243ecb95dec5fb696ec49_SeqId_47_] into tmpdir=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithWeeklyPolicy/7a35b3ad186d84bd239e22f355d22d96/.tmp, totalSize=176.8 K 2023-03-11 22:53:43,518 DEBUG [RS:0;jenkins-hbase20:41843-longCompactions-0] compactions.Compactor(207): Compacting 3de38c94fd3b4535b71a065eb98ab2b1, keycount=1000, bloomtype=ROW, size=165.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878807597 2023-03-11 22:53:43,518 DEBUG [RS:0;jenkins-hbase20:41843-longCompactions-0] compactions.Compactor(207): Compacting 3e47eb2650b74d45afb6b8778b4dc60b, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621207597 2023-03-11 22:53:43,519 DEBUG [RS:0;jenkins-hbase20:41843-longCompactions-0] compactions.Compactor(207): Compacting 201092c00b5243ecb95dec5fb696ec49_SeqId_47_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965207597 2023-03-11 22:53:43,519 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-03-11 22:53:43,520 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 22:53:43,522 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015120181687f2b46044e55bb45c1f207a228ea to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015120181687f2b46044e55bb45c1f207a228ea 2023-03-11 22:53:43,523 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015120512e60283480a48519bdc77251cf7eb71 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015120512e60283480a48519bdc77251cf7eb71 2023-03-11 22:53:43,523 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithWeeklyPolicy 2 expired mob files are deleted 2023-03-11 22:53:43,523 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-03-11 22:53:43,524 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-03-11 22:53:43,524 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-03-11 22:53:43,524 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] mob.MobUtils(840): end MOB compaction of files for table='testMinorCompactionWithWeeklyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-11 22:53:43,525 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=26, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-03-11 22:53:43,526 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE in 1.8310 sec 2023-03-11 22:53:43,540 INFO [RS:0;jenkins-hbase20:41843-longCompactions-0] throttle.PressureAwareThroughputController(145): 7a35b3ad186d84bd239e22f355d22d96#family1#compaction#35 average throughput is 14.06 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-11 22:53:43,576 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithWeeklyPolicy/7a35b3ad186d84bd239e22f355d22d96/family1/76a666e886994e81bf7097172f0f608e, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithWeeklyPolicy/7a35b3ad186d84bd239e22f355d22d96/family1/cc1a8d6bb21845e8a222ec6b935e2cba, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithWeeklyPolicy/7a35b3ad186d84bd239e22f355d22d96/family1/e4cd5d1de6434cea8b494513aae5bcaf, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithWeeklyPolicy/7a35b3ad186d84bd239e22f355d22d96/family1/2394e1bede7d4fe7bd38886d2442aeb1, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithWeeklyPolicy/7a35b3ad186d84bd239e22f355d22d96/family1/8accc349dfeb466eba39f387109bf799, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithWeeklyPolicy/7a35b3ad186d84bd239e22f355d22d96/family1/9ec45af514c74f4f8f0e81c18bf85c03, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithWeeklyPolicy/7a35b3ad186d84bd239e22f355d22d96/family1/87a156182c6f4c6eb28a496356d1e281, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithWeeklyPolicy/7a35b3ad186d84bd239e22f355d22d96/family1/8bfa0eeaf5524f16a4a8e30cba660bd0, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithWeeklyPolicy/7a35b3ad186d84bd239e22f355d22d96/family1/02fd650251ab4c72a5faf1caf41a0b7c, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithWeeklyPolicy/7a35b3ad186d84bd239e22f355d22d96/family1/67f5d616f2fe48908a4a58361a1b4ba3_SeqId_44_] to archive 2023-03-11 22:53:43,577 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 22:53:43,579 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithWeeklyPolicy/7a35b3ad186d84bd239e22f355d22d96/family1/76a666e886994e81bf7097172f0f608e to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMinorCompactionWithWeeklyPolicy/7a35b3ad186d84bd239e22f355d22d96/family1/76a666e886994e81bf7097172f0f608e 2023-03-11 22:53:43,580 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithWeeklyPolicy/7a35b3ad186d84bd239e22f355d22d96/family1/cc1a8d6bb21845e8a222ec6b935e2cba to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMinorCompactionWithWeeklyPolicy/7a35b3ad186d84bd239e22f355d22d96/family1/cc1a8d6bb21845e8a222ec6b935e2cba 2023-03-11 22:53:43,582 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithWeeklyPolicy/7a35b3ad186d84bd239e22f355d22d96/family1/e4cd5d1de6434cea8b494513aae5bcaf to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMinorCompactionWithWeeklyPolicy/7a35b3ad186d84bd239e22f355d22d96/family1/e4cd5d1de6434cea8b494513aae5bcaf 2023-03-11 22:53:43,583 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithWeeklyPolicy/7a35b3ad186d84bd239e22f355d22d96/family1/2394e1bede7d4fe7bd38886d2442aeb1 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMinorCompactionWithWeeklyPolicy/7a35b3ad186d84bd239e22f355d22d96/family1/2394e1bede7d4fe7bd38886d2442aeb1 2023-03-11 22:53:43,585 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithWeeklyPolicy/7a35b3ad186d84bd239e22f355d22d96/family1/8accc349dfeb466eba39f387109bf799 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMinorCompactionWithWeeklyPolicy/7a35b3ad186d84bd239e22f355d22d96/family1/8accc349dfeb466eba39f387109bf799 2023-03-11 22:53:43,586 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithWeeklyPolicy/7a35b3ad186d84bd239e22f355d22d96/family1/9ec45af514c74f4f8f0e81c18bf85c03 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMinorCompactionWithWeeklyPolicy/7a35b3ad186d84bd239e22f355d22d96/family1/9ec45af514c74f4f8f0e81c18bf85c03 2023-03-11 22:53:43,587 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithWeeklyPolicy/7a35b3ad186d84bd239e22f355d22d96/family1/87a156182c6f4c6eb28a496356d1e281 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMinorCompactionWithWeeklyPolicy/7a35b3ad186d84bd239e22f355d22d96/family1/87a156182c6f4c6eb28a496356d1e281 2023-03-11 22:53:43,588 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithWeeklyPolicy/7a35b3ad186d84bd239e22f355d22d96/family1/8bfa0eeaf5524f16a4a8e30cba660bd0 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMinorCompactionWithWeeklyPolicy/7a35b3ad186d84bd239e22f355d22d96/family1/8bfa0eeaf5524f16a4a8e30cba660bd0 2023-03-11 22:53:43,590 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithWeeklyPolicy/7a35b3ad186d84bd239e22f355d22d96/family1/02fd650251ab4c72a5faf1caf41a0b7c to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMinorCompactionWithWeeklyPolicy/7a35b3ad186d84bd239e22f355d22d96/family1/02fd650251ab4c72a5faf1caf41a0b7c 2023-03-11 22:53:43,591 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithWeeklyPolicy/7a35b3ad186d84bd239e22f355d22d96/family1/67f5d616f2fe48908a4a58361a1b4ba3_SeqId_44_ to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMinorCompactionWithWeeklyPolicy/7a35b3ad186d84bd239e22f355d22d96/family1/67f5d616f2fe48908a4a58361a1b4ba3_SeqId_44_ 2023-03-11 22:53:43,622 INFO [Listener at localhost.localdomain/41563] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompactionWithWeeklyPolicy Thread=254 (was 255), OpenFileDescriptor=596 (was 609), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=330 (was 390), ProcessCount=168 (was 168), AvailableMemoryMB=21788 (was 21823) 2023-03-11 22:53:43,632 INFO [Listener at localhost.localdomain/41563] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testScannerOnBulkLoadRefHFiles Thread=254, OpenFileDescriptor=596, MaxFileDescriptor=60000, SystemLoadAverage=330, ProcessCount=168, AvailableMemoryMB=21787 2023-03-11 22:53:43,634 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-03-11 22:53:43,636 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles 2023-03-11 22:53:43,637 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_PRE_OPERATION 2023-03-11 22:53:43,638 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(697): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testScannerOnBulkLoadRefHFiles" procId is: 27 2023-03-11 22:53:43,638 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-11 22:53:43,638 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-03-11 22:53:43,640 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/.tmp/data/default/testScannerOnBulkLoadRefHFiles/078337168df669f0c39d86df4d8f6540 2023-03-11 22:53:43,640 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/.tmp/data/default/testScannerOnBulkLoadRefHFiles/2bd54e0456c101f274068eb0eb037545 2023-03-11 22:53:43,640 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/.tmp/data/default/testScannerOnBulkLoadRefHFiles/8bff51e742e5ddadbd357b4ea853b5d8 2023-03-11 22:53:43,640 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/.tmp/data/default/testScannerOnBulkLoadRefHFiles/078337168df669f0c39d86df4d8f6540 empty. 2023-03-11 22:53:43,641 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/.tmp/data/default/testScannerOnBulkLoadRefHFiles/2bd54e0456c101f274068eb0eb037545 empty. 2023-03-11 22:53:43,641 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/.tmp/data/default/testScannerOnBulkLoadRefHFiles/8bff51e742e5ddadbd357b4ea853b5d8 empty. 2023-03-11 22:53:43,641 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/.tmp/data/default/testScannerOnBulkLoadRefHFiles/078337168df669f0c39d86df4d8f6540 2023-03-11 22:53:43,641 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/.tmp/data/default/testScannerOnBulkLoadRefHFiles/2bd54e0456c101f274068eb0eb037545 2023-03-11 22:53:43,641 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/.tmp/data/default/testScannerOnBulkLoadRefHFiles/8bff51e742e5ddadbd357b4ea853b5d8 2023-03-11 22:53:43,641 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testScannerOnBulkLoadRefHFiles regions 2023-03-11 22:53:43,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-03-11 22:53:43,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-03-11 22:53:44,050 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/.tmp/data/default/testScannerOnBulkLoadRefHFiles/.tabledesc/.tableinfo.0000000001 2023-03-11 22:53:44,052 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(7675): creating {ENCODED => 078337168df669f0c39d86df4d8f6540, NAME => 'testScannerOnBulkLoadRefHFiles,,1678575223634.078337168df669f0c39d86df4d8f6540.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/.tmp 2023-03-11 22:53:44,052 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(7675): creating {ENCODED => 8bff51e742e5ddadbd357b4ea853b5d8, NAME => 'testScannerOnBulkLoadRefHFiles,2,1678575223634.8bff51e742e5ddadbd357b4ea853b5d8.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/.tmp 2023-03-11 22:53:44,053 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(7675): creating {ENCODED => 2bd54e0456c101f274068eb0eb037545, NAME => 'testScannerOnBulkLoadRefHFiles,1,1678575223634.2bd54e0456c101f274068eb0eb037545.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/.tmp 2023-03-11 22:53:44,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-03-11 22:53:44,467 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,,1678575223634.078337168df669f0c39d86df4d8f6540.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-11 22:53:44,467 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1604): Closing 078337168df669f0c39d86df4d8f6540, disabling compactions & flushes 2023-03-11 22:53:44,467 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,,1678575223634.078337168df669f0c39d86df4d8f6540. 2023-03-11 22:53:44,467 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,,1678575223634.078337168df669f0c39d86df4d8f6540. 2023-03-11 22:53:44,467 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,,1678575223634.078337168df669f0c39d86df4d8f6540. after waiting 0 ms 2023-03-11 22:53:44,467 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,,1678575223634.078337168df669f0c39d86df4d8f6540. 2023-03-11 22:53:44,468 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,,1678575223634.078337168df669f0c39d86df4d8f6540. 2023-03-11 22:53:44,468 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1558): Region close journal for 078337168df669f0c39d86df4d8f6540: 2023-03-11 22:53:44,469 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,2,1678575223634.8bff51e742e5ddadbd357b4ea853b5d8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-11 22:53:44,469 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1604): Closing 8bff51e742e5ddadbd357b4ea853b5d8, disabling compactions & flushes 2023-03-11 22:53:44,469 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,2,1678575223634.8bff51e742e5ddadbd357b4ea853b5d8. 2023-03-11 22:53:44,470 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,2,1678575223634.8bff51e742e5ddadbd357b4ea853b5d8. 2023-03-11 22:53:44,470 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,2,1678575223634.8bff51e742e5ddadbd357b4ea853b5d8. after waiting 0 ms 2023-03-11 22:53:44,470 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,2,1678575223634.8bff51e742e5ddadbd357b4ea853b5d8. 2023-03-11 22:53:44,470 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,2,1678575223634.8bff51e742e5ddadbd357b4ea853b5d8. 2023-03-11 22:53:44,470 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1558): Region close journal for 8bff51e742e5ddadbd357b4ea853b5d8: 2023-03-11 22:53:44,470 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,1,1678575223634.2bd54e0456c101f274068eb0eb037545.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-11 22:53:44,470 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1604): Closing 2bd54e0456c101f274068eb0eb037545, disabling compactions & flushes 2023-03-11 22:53:44,470 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,1,1678575223634.2bd54e0456c101f274068eb0eb037545. 2023-03-11 22:53:44,471 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,1,1678575223634.2bd54e0456c101f274068eb0eb037545. 2023-03-11 22:53:44,471 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,1,1678575223634.2bd54e0456c101f274068eb0eb037545. after waiting 0 ms 2023-03-11 22:53:44,471 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,1,1678575223634.2bd54e0456c101f274068eb0eb037545. 2023-03-11 22:53:44,471 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,1,1678575223634.2bd54e0456c101f274068eb0eb037545. 2023-03-11 22:53:44,471 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1558): Region close journal for 2bd54e0456c101f274068eb0eb037545: 2023-03-11 22:53:44,477 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_ADD_TO_META 2023-03-11 22:53:44,478 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,,1678575223634.078337168df669f0c39d86df4d8f6540.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1678575224478"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678575224478"}]},"ts":"1678575224478"} 2023-03-11 22:53:44,478 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,2,1678575223634.8bff51e742e5ddadbd357b4ea853b5d8.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1678575224478"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678575224478"}]},"ts":"1678575224478"} 2023-03-11 22:53:44,478 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,1,1678575223634.2bd54e0456c101f274068eb0eb037545.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1678575224478"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678575224478"}]},"ts":"1678575224478"} 2023-03-11 22:53:44,481 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-03-11 22:53:44,482 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-11 22:53:44,482 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testScannerOnBulkLoadRefHFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678575224482"}]},"ts":"1678575224482"} 2023-03-11 22:53:44,483 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testScannerOnBulkLoadRefHFiles, state=ENABLING in hbase:meta 2023-03-11 22:53:44,485 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=078337168df669f0c39d86df4d8f6540, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=2bd54e0456c101f274068eb0eb037545, ASSIGN}, {pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=8bff51e742e5ddadbd357b4ea853b5d8, ASSIGN}] 2023-03-11 22:53:44,487 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=8bff51e742e5ddadbd357b4ea853b5d8, ASSIGN 2023-03-11 22:53:44,487 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=078337168df669f0c39d86df4d8f6540, ASSIGN 2023-03-11 22:53:44,487 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=2bd54e0456c101f274068eb0eb037545, ASSIGN 2023-03-11 22:53:44,487 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=078337168df669f0c39d86df4d8f6540, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,41843,1678575183185; forceNewPlan=false, retain=false 2023-03-11 22:53:44,488 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=2bd54e0456c101f274068eb0eb037545, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,41843,1678575183185; forceNewPlan=false, retain=false 2023-03-11 22:53:44,487 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=8bff51e742e5ddadbd357b4ea853b5d8, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,41843,1678575183185; forceNewPlan=false, retain=false 2023-03-11 22:53:44,640 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=2bd54e0456c101f274068eb0eb037545, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:44,640 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=078337168df669f0c39d86df4d8f6540, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:44,640 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=8bff51e742e5ddadbd357b4ea853b5d8, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:44,641 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,1,1678575223634.2bd54e0456c101f274068eb0eb037545.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1678575224640"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1678575224640"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678575224640"}]},"ts":"1678575224640"} 2023-03-11 22:53:44,641 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,,1678575223634.078337168df669f0c39d86df4d8f6540.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1678575224640"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1678575224640"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678575224640"}]},"ts":"1678575224640"} 2023-03-11 22:53:44,641 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,2,1678575223634.8bff51e742e5ddadbd357b4ea853b5d8.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1678575224640"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1678575224640"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678575224640"}]},"ts":"1678575224640"} 2023-03-11 22:53:44,645 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=29, state=RUNNABLE; OpenRegionProcedure 2bd54e0456c101f274068eb0eb037545, server=jenkins-hbase20.apache.org,41843,1678575183185}] 2023-03-11 22:53:44,646 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=32, ppid=28, state=RUNNABLE; OpenRegionProcedure 078337168df669f0c39d86df4d8f6540, server=jenkins-hbase20.apache.org,41843,1678575183185}] 2023-03-11 22:53:44,647 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=33, ppid=30, state=RUNNABLE; OpenRegionProcedure 8bff51e742e5ddadbd357b4ea853b5d8, server=jenkins-hbase20.apache.org,41843,1678575183185}] 2023-03-11 22:53:44,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-03-11 22:53:44,771 DEBUG [RS:0;jenkins-hbase20:41843-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithWeeklyPolicy/7a35b3ad186d84bd239e22f355d22d96/.tmp/family1/b567e269679f45bdaff30f4b33e3c772 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithWeeklyPolicy/7a35b3ad186d84bd239e22f355d22d96/family1/b567e269679f45bdaff30f4b33e3c772 2023-03-11 22:53:44,778 INFO [RS:0;jenkins-hbase20:41843-longCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 7a35b3ad186d84bd239e22f355d22d96/family1 of 7a35b3ad186d84bd239e22f355d22d96 into b567e269679f45bdaff30f4b33e3c772(size=166.4 K), total size for store is 166.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-11 22:53:44,778 DEBUG [RS:0;jenkins-hbase20:41843-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for 7a35b3ad186d84bd239e22f355d22d96: 2023-03-11 22:53:44,778 INFO [RS:0;jenkins-hbase20:41843-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithWeeklyPolicy,,1678575211483.7a35b3ad186d84bd239e22f355d22d96., storeName=family1, fileCount=3, fileSize=176.8 K (165.1 K, 6.6 K, 5.2 K), priority=2, time=1678575223517; duration=1sec 2023-03-11 22:53:44,778 DEBUG [RS:0;jenkins-hbase20:41843-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-11 22:53:44,801 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testScannerOnBulkLoadRefHFiles,2,1678575223634.8bff51e742e5ddadbd357b4ea853b5d8. 2023-03-11 22:53:44,802 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8bff51e742e5ddadbd357b4ea853b5d8, NAME => 'testScannerOnBulkLoadRefHFiles,2,1678575223634.8bff51e742e5ddadbd357b4ea853b5d8.', STARTKEY => '2', ENDKEY => ''} 2023-03-11 22:53:44,802 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 8bff51e742e5ddadbd357b4ea853b5d8 2023-03-11 22:53:44,802 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,2,1678575223634.8bff51e742e5ddadbd357b4ea853b5d8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-11 22:53:44,802 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 8bff51e742e5ddadbd357b4ea853b5d8 2023-03-11 22:53:44,802 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 8bff51e742e5ddadbd357b4ea853b5d8 2023-03-11 22:53:44,804 INFO [StoreOpener-8bff51e742e5ddadbd357b4ea853b5d8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 8bff51e742e5ddadbd357b4ea853b5d8 2023-03-11 22:53:44,805 DEBUG [StoreOpener-8bff51e742e5ddadbd357b4ea853b5d8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testScannerOnBulkLoadRefHFiles/8bff51e742e5ddadbd357b4ea853b5d8/family1 2023-03-11 22:53:44,805 DEBUG [StoreOpener-8bff51e742e5ddadbd357b4ea853b5d8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testScannerOnBulkLoadRefHFiles/8bff51e742e5ddadbd357b4ea853b5d8/family1 2023-03-11 22:53:44,806 INFO [StoreOpener-8bff51e742e5ddadbd357b4ea853b5d8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8bff51e742e5ddadbd357b4ea853b5d8 columnFamilyName family1 2023-03-11 22:53:44,808 INFO [StoreOpener-8bff51e742e5ddadbd357b4ea853b5d8-1] regionserver.HStore(310): Store=8bff51e742e5ddadbd357b4ea853b5d8/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-11 22:53:44,808 INFO [StoreOpener-8bff51e742e5ddadbd357b4ea853b5d8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 8bff51e742e5ddadbd357b4ea853b5d8 2023-03-11 22:53:44,810 DEBUG [StoreOpener-8bff51e742e5ddadbd357b4ea853b5d8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testScannerOnBulkLoadRefHFiles/8bff51e742e5ddadbd357b4ea853b5d8/family2 2023-03-11 22:53:44,810 DEBUG [StoreOpener-8bff51e742e5ddadbd357b4ea853b5d8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testScannerOnBulkLoadRefHFiles/8bff51e742e5ddadbd357b4ea853b5d8/family2 2023-03-11 22:53:44,811 INFO [StoreOpener-8bff51e742e5ddadbd357b4ea853b5d8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8bff51e742e5ddadbd357b4ea853b5d8 columnFamilyName family2 2023-03-11 22:53:44,813 INFO [StoreOpener-8bff51e742e5ddadbd357b4ea853b5d8-1] regionserver.HStore(310): Store=8bff51e742e5ddadbd357b4ea853b5d8/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-11 22:53:44,814 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testScannerOnBulkLoadRefHFiles/8bff51e742e5ddadbd357b4ea853b5d8 2023-03-11 22:53:44,815 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testScannerOnBulkLoadRefHFiles/8bff51e742e5ddadbd357b4ea853b5d8 2023-03-11 22:53:44,818 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-11 22:53:44,820 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 8bff51e742e5ddadbd357b4ea853b5d8 2023-03-11 22:53:44,823 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testScannerOnBulkLoadRefHFiles/8bff51e742e5ddadbd357b4ea853b5d8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-11 22:53:44,823 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 8bff51e742e5ddadbd357b4ea853b5d8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69018211, jitterRate=0.02845148742198944}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-11 22:53:44,823 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 8bff51e742e5ddadbd357b4ea853b5d8: 2023-03-11 22:53:44,824 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,2,1678575223634.8bff51e742e5ddadbd357b4ea853b5d8., pid=33, masterSystemTime=1678575224798 2023-03-11 22:53:44,827 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,2,1678575223634.8bff51e742e5ddadbd357b4ea853b5d8. 2023-03-11 22:53:44,827 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testScannerOnBulkLoadRefHFiles,2,1678575223634.8bff51e742e5ddadbd357b4ea853b5d8. 2023-03-11 22:53:44,827 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testScannerOnBulkLoadRefHFiles,,1678575223634.078337168df669f0c39d86df4d8f6540. 2023-03-11 22:53:44,827 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 078337168df669f0c39d86df4d8f6540, NAME => 'testScannerOnBulkLoadRefHFiles,,1678575223634.078337168df669f0c39d86df4d8f6540.', STARTKEY => '', ENDKEY => '1'} 2023-03-11 22:53:44,827 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 078337168df669f0c39d86df4d8f6540 2023-03-11 22:53:44,827 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=8bff51e742e5ddadbd357b4ea853b5d8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:44,827 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,,1678575223634.078337168df669f0c39d86df4d8f6540.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-11 22:53:44,828 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 078337168df669f0c39d86df4d8f6540 2023-03-11 22:53:44,828 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 078337168df669f0c39d86df4d8f6540 2023-03-11 22:53:44,828 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,2,1678575223634.8bff51e742e5ddadbd357b4ea853b5d8.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1678575224827"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1678575224827"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678575224827"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678575224827"}]},"ts":"1678575224827"} 2023-03-11 22:53:44,829 INFO [StoreOpener-078337168df669f0c39d86df4d8f6540-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 078337168df669f0c39d86df4d8f6540 2023-03-11 22:53:44,831 DEBUG [StoreOpener-078337168df669f0c39d86df4d8f6540-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testScannerOnBulkLoadRefHFiles/078337168df669f0c39d86df4d8f6540/family1 2023-03-11 22:53:44,831 DEBUG [StoreOpener-078337168df669f0c39d86df4d8f6540-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testScannerOnBulkLoadRefHFiles/078337168df669f0c39d86df4d8f6540/family1 2023-03-11 22:53:44,832 INFO [StoreOpener-078337168df669f0c39d86df4d8f6540-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 078337168df669f0c39d86df4d8f6540 columnFamilyName family1 2023-03-11 22:53:44,832 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=33, resume processing ppid=30 2023-03-11 22:53:44,833 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=33, ppid=30, state=SUCCESS; OpenRegionProcedure 8bff51e742e5ddadbd357b4ea853b5d8, server=jenkins-hbase20.apache.org,41843,1678575183185 in 183 msec 2023-03-11 22:53:44,833 INFO [StoreOpener-078337168df669f0c39d86df4d8f6540-1] regionserver.HStore(310): Store=078337168df669f0c39d86df4d8f6540/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-11 22:53:44,834 INFO [StoreOpener-078337168df669f0c39d86df4d8f6540-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 078337168df669f0c39d86df4d8f6540 2023-03-11 22:53:44,834 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=8bff51e742e5ddadbd357b4ea853b5d8, ASSIGN in 348 msec 2023-03-11 22:53:44,835 DEBUG [StoreOpener-078337168df669f0c39d86df4d8f6540-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testScannerOnBulkLoadRefHFiles/078337168df669f0c39d86df4d8f6540/family2 2023-03-11 22:53:44,835 DEBUG [StoreOpener-078337168df669f0c39d86df4d8f6540-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testScannerOnBulkLoadRefHFiles/078337168df669f0c39d86df4d8f6540/family2 2023-03-11 22:53:44,836 INFO [StoreOpener-078337168df669f0c39d86df4d8f6540-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 078337168df669f0c39d86df4d8f6540 columnFamilyName family2 2023-03-11 22:53:44,837 INFO [StoreOpener-078337168df669f0c39d86df4d8f6540-1] regionserver.HStore(310): Store=078337168df669f0c39d86df4d8f6540/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-11 22:53:44,838 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testScannerOnBulkLoadRefHFiles/078337168df669f0c39d86df4d8f6540 2023-03-11 22:53:44,838 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testScannerOnBulkLoadRefHFiles/078337168df669f0c39d86df4d8f6540 2023-03-11 22:53:44,840 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-11 22:53:44,841 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 078337168df669f0c39d86df4d8f6540 2023-03-11 22:53:44,843 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testScannerOnBulkLoadRefHFiles/078337168df669f0c39d86df4d8f6540/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-11 22:53:44,843 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 078337168df669f0c39d86df4d8f6540; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62541725, jitterRate=-0.06805567443370819}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-11 22:53:44,843 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 078337168df669f0c39d86df4d8f6540: 2023-03-11 22:53:44,844 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,,1678575223634.078337168df669f0c39d86df4d8f6540., pid=32, masterSystemTime=1678575224798 2023-03-11 22:53:44,846 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,,1678575223634.078337168df669f0c39d86df4d8f6540. 2023-03-11 22:53:44,846 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testScannerOnBulkLoadRefHFiles,,1678575223634.078337168df669f0c39d86df4d8f6540. 2023-03-11 22:53:44,846 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testScannerOnBulkLoadRefHFiles,1,1678575223634.2bd54e0456c101f274068eb0eb037545. 2023-03-11 22:53:44,846 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2bd54e0456c101f274068eb0eb037545, NAME => 'testScannerOnBulkLoadRefHFiles,1,1678575223634.2bd54e0456c101f274068eb0eb037545.', STARTKEY => '1', ENDKEY => '2'} 2023-03-11 22:53:44,846 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=078337168df669f0c39d86df4d8f6540, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:44,846 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 2bd54e0456c101f274068eb0eb037545 2023-03-11 22:53:44,846 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,1,1678575223634.2bd54e0456c101f274068eb0eb037545.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-11 22:53:44,846 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,,1678575223634.078337168df669f0c39d86df4d8f6540.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1678575224846"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1678575224846"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678575224846"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678575224846"}]},"ts":"1678575224846"} 2023-03-11 22:53:44,847 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 2bd54e0456c101f274068eb0eb037545 2023-03-11 22:53:44,847 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 2bd54e0456c101f274068eb0eb037545 2023-03-11 22:53:44,848 INFO [StoreOpener-2bd54e0456c101f274068eb0eb037545-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 2bd54e0456c101f274068eb0eb037545 2023-03-11 22:53:44,850 DEBUG [StoreOpener-2bd54e0456c101f274068eb0eb037545-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testScannerOnBulkLoadRefHFiles/2bd54e0456c101f274068eb0eb037545/family1 2023-03-11 22:53:44,850 DEBUG [StoreOpener-2bd54e0456c101f274068eb0eb037545-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testScannerOnBulkLoadRefHFiles/2bd54e0456c101f274068eb0eb037545/family1 2023-03-11 22:53:44,850 INFO [StoreOpener-2bd54e0456c101f274068eb0eb037545-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2bd54e0456c101f274068eb0eb037545 columnFamilyName family1 2023-03-11 22:53:44,850 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=32, resume processing ppid=28 2023-03-11 22:53:44,851 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=32, ppid=28, state=SUCCESS; OpenRegionProcedure 078337168df669f0c39d86df4d8f6540, server=jenkins-hbase20.apache.org,41843,1678575183185 in 202 msec 2023-03-11 22:53:44,852 INFO [StoreOpener-2bd54e0456c101f274068eb0eb037545-1] regionserver.HStore(310): Store=2bd54e0456c101f274068eb0eb037545/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-11 22:53:44,852 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=078337168df669f0c39d86df4d8f6540, ASSIGN in 365 msec 2023-03-11 22:53:44,852 INFO [StoreOpener-2bd54e0456c101f274068eb0eb037545-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 2bd54e0456c101f274068eb0eb037545 2023-03-11 22:53:44,854 DEBUG [StoreOpener-2bd54e0456c101f274068eb0eb037545-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testScannerOnBulkLoadRefHFiles/2bd54e0456c101f274068eb0eb037545/family2 2023-03-11 22:53:44,854 DEBUG [StoreOpener-2bd54e0456c101f274068eb0eb037545-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testScannerOnBulkLoadRefHFiles/2bd54e0456c101f274068eb0eb037545/family2 2023-03-11 22:53:44,854 INFO [StoreOpener-2bd54e0456c101f274068eb0eb037545-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2bd54e0456c101f274068eb0eb037545 columnFamilyName family2 2023-03-11 22:53:44,855 INFO [StoreOpener-2bd54e0456c101f274068eb0eb037545-1] regionserver.HStore(310): Store=2bd54e0456c101f274068eb0eb037545/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-11 22:53:44,856 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testScannerOnBulkLoadRefHFiles/2bd54e0456c101f274068eb0eb037545 2023-03-11 22:53:44,856 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testScannerOnBulkLoadRefHFiles/2bd54e0456c101f274068eb0eb037545 2023-03-11 22:53:44,858 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-11 22:53:44,859 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 2bd54e0456c101f274068eb0eb037545 2023-03-11 22:53:44,861 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testScannerOnBulkLoadRefHFiles/2bd54e0456c101f274068eb0eb037545/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-11 22:53:44,861 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 2bd54e0456c101f274068eb0eb037545; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70381995, jitterRate=0.04877345263957977}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-11 22:53:44,861 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 2bd54e0456c101f274068eb0eb037545: 2023-03-11 22:53:44,862 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,1,1678575223634.2bd54e0456c101f274068eb0eb037545., pid=31, masterSystemTime=1678575224798 2023-03-11 22:53:44,864 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,1,1678575223634.2bd54e0456c101f274068eb0eb037545. 2023-03-11 22:53:44,864 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testScannerOnBulkLoadRefHFiles,1,1678575223634.2bd54e0456c101f274068eb0eb037545. 2023-03-11 22:53:44,865 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=2bd54e0456c101f274068eb0eb037545, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:44,866 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,1,1678575223634.2bd54e0456c101f274068eb0eb037545.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1678575224865"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1678575224865"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678575224865"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678575224865"}]},"ts":"1678575224865"} 2023-03-11 22:53:44,867 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithWeeklyPolicy/7a35b3ad186d84bd239e22f355d22d96/family1/3de38c94fd3b4535b71a065eb98ab2b1, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithWeeklyPolicy/7a35b3ad186d84bd239e22f355d22d96/family1/3e47eb2650b74d45afb6b8778b4dc60b, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithWeeklyPolicy/7a35b3ad186d84bd239e22f355d22d96/family1/201092c00b5243ecb95dec5fb696ec49_SeqId_47_] to archive 2023-03-11 22:53:44,868 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 22:53:44,870 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithWeeklyPolicy/7a35b3ad186d84bd239e22f355d22d96/family1/3de38c94fd3b4535b71a065eb98ab2b1 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMinorCompactionWithWeeklyPolicy/7a35b3ad186d84bd239e22f355d22d96/family1/3de38c94fd3b4535b71a065eb98ab2b1 2023-03-11 22:53:44,871 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=29 2023-03-11 22:53:44,871 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=29, state=SUCCESS; OpenRegionProcedure 2bd54e0456c101f274068eb0eb037545, server=jenkins-hbase20.apache.org,41843,1678575183185 in 223 msec 2023-03-11 22:53:44,872 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithWeeklyPolicy/7a35b3ad186d84bd239e22f355d22d96/family1/3e47eb2650b74d45afb6b8778b4dc60b to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMinorCompactionWithWeeklyPolicy/7a35b3ad186d84bd239e22f355d22d96/family1/3e47eb2650b74d45afb6b8778b4dc60b 2023-03-11 22:53:44,873 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=27 2023-03-11 22:53:44,874 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=2bd54e0456c101f274068eb0eb037545, ASSIGN in 386 msec 2023-03-11 22:53:44,874 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithWeeklyPolicy/7a35b3ad186d84bd239e22f355d22d96/family1/201092c00b5243ecb95dec5fb696ec49_SeqId_47_ to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMinorCompactionWithWeeklyPolicy/7a35b3ad186d84bd239e22f355d22d96/family1/201092c00b5243ecb95dec5fb696ec49_SeqId_47_ 2023-03-11 22:53:44,875 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-11 22:53:44,875 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testScannerOnBulkLoadRefHFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678575224875"}]},"ts":"1678575224875"} 2023-03-11 22:53:44,876 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testScannerOnBulkLoadRefHFiles, state=ENABLED in hbase:meta 2023-03-11 22:53:44,878 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_POST_OPERATION 2023-03-11 22:53:44,880 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles in 1.2430 sec 2023-03-11 22:53:45,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-03-11 22:53:45,747 INFO [Listener at localhost.localdomain/41563] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testScannerOnBulkLoadRefHFiles, procId: 27 completed 2023-03-11 22:53:45,764 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-11 22:53:45,767 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(165): Submitting procedure testScannerOnBulkLoadRefHFiles 2023-03-11 22:53:45,767 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testScannerOnBulkLoadRefHFiles' 2023-03-11 22:53:45,767 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:53:45,767 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' 2023-03-11 22:53:45,768 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testScannerOnBulkLoadRefHFiles', kicking off acquire phase on members. 2023-03-11 22:53:45,768 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-11 22:53:45,768 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-03-11 22:53:45,770 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:45,770 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:53:45,770 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:53:45,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:53:45,771 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:45,771 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 22:53:45,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-03-11 22:53:45,772 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-11 22:53:45,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 22:53:45,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-03-11 22:53:45,772 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testScannerOnBulkLoadRefHFiles 2023-03-11 22:53:45,773 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testScannerOnBulkLoadRefHFiles 2023-03-11 22:53:45,773 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testScannerOnBulkLoadRefHFiles' with timeout 60000ms 2023-03-11 22:53:45,773 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:53:45,773 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' stage 2023-03-11 22:53:45,773 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,2,1678575223634.8bff51e742e5ddadbd357b4ea853b5d8. 2023-03-11 22:53:45,773 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,1,1678575223634.2bd54e0456c101f274068eb0eb037545. 2023-03-11 22:53:45,773 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-11 22:53:45,774 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 22:53:45,773 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,2,1678575223634.8bff51e742e5ddadbd357b4ea853b5d8. started... 2023-03-11 22:53:45,774 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,,1678575223634.078337168df669f0c39d86df4d8f6540. 2023-03-11 22:53:45,774 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,1,1678575223634.2bd54e0456c101f274068eb0eb037545. started... 2023-03-11 22:53:45,775 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8bff51e742e5ddadbd357b4ea853b5d8 2/2 column families, dataSize=48 B heapSize=632 B 2023-03-11 22:53:45,774 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,,1678575223634.078337168df669f0c39d86df4d8f6540. started... 2023-03-11 22:53:45,775 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 2bd54e0456c101f274068eb0eb037545: 2023-03-11 22:53:45,776 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,1,1678575223634.2bd54e0456c101f274068eb0eb037545. 2023-03-11 22:53:45,776 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-11 22:53:45,777 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 078337168df669f0c39d86df4d8f6540: 2023-03-11 22:53:45,777 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,,1678575223634.078337168df669f0c39d86df4d8f6540. 2023-03-11 22:53:45,777 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-11 22:53:46,202 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303118923e843004f43e8b23c803b8ec2aae6 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202303118923e843004f43e8b23c803b8ec2aae6 2023-03-11 22:53:46,541 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testScannerOnBulkLoadRefHFiles' 2023-03-11 22:53:46,608 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=48, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testScannerOnBulkLoadRefHFiles/8bff51e742e5ddadbd357b4ea853b5d8/.tmp/family1/6efb42d622e64513b8616efe80fd7bd8 2023-03-11 22:53:46,615 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testScannerOnBulkLoadRefHFiles/8bff51e742e5ddadbd357b4ea853b5d8/.tmp/family1/6efb42d622e64513b8616efe80fd7bd8 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testScannerOnBulkLoadRefHFiles/8bff51e742e5ddadbd357b4ea853b5d8/family1/6efb42d622e64513b8616efe80fd7bd8 2023-03-11 22:53:46,621 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testScannerOnBulkLoadRefHFiles/8bff51e742e5ddadbd357b4ea853b5d8/family1/6efb42d622e64513b8616efe80fd7bd8, entries=1, sequenceid=5, filesize=4.9 K 2023-03-11 22:53:46,622 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~48 B/48, heapSize ~360 B/360, currentSize=0 B/0 for 8bff51e742e5ddadbd357b4ea853b5d8 in 847ms, sequenceid=5, compaction requested=false 2023-03-11 22:53:46,623 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8bff51e742e5ddadbd357b4ea853b5d8: 2023-03-11 22:53:46,623 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,2,1678575223634.8bff51e742e5ddadbd357b4ea853b5d8. 2023-03-11 22:53:46,623 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-11 22:53:46,623 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-11 22:53:46,623 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:46,623 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally acquired 2023-03-11 22:53:46,623 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure (testScannerOnBulkLoadRefHFiles) in zk 2023-03-11 22:53:46,624 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:46,624 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-11 22:53:46,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:46,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:53:46,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:53:46,625 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-11 22:53:46,625 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testScannerOnBulkLoadRefHFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 22:53:46,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:53:46,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:53:46,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-11 22:53:46,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:46,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:53:46,627 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure 'testScannerOnBulkLoadRefHFiles' on coordinator 2023-03-11 22:53:46,627 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2df8d2c8[Count = 0] remaining members to acquire global barrier 2023-03-11 22:53:46,627 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'in-barrier' execution. 2023-03-11 22:53:46,627 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-11 22:53:46,628 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-11 22:53:46,628 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-11 22:53:46,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-11 22:53:46,628 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testScannerOnBulkLoadRefHFiles' received 'reached' from coordinator. 2023-03-11 22:53:46,628 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally completed 2023-03-11 22:53:46,628 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testScannerOnBulkLoadRefHFiles' completed for member 'jenkins-hbase20.apache.org,41843,1678575183185' in zk 2023-03-11 22:53:46,628 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:46,628 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 22:53:46,629 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:46,629 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testScannerOnBulkLoadRefHFiles' has notified controller of completion 2023-03-11 22:53:46,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:46,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:53:46,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:53:46,629 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:53:46,629 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testScannerOnBulkLoadRefHFiles' completed. 2023-03-11 22:53:46,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:53:46,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:53:46,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-11 22:53:46,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:46,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:53:46,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-11 22:53:46,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:46,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testScannerOnBulkLoadRefHFiles' member 'jenkins-hbase20.apache.org,41843,1678575183185': 2023-03-11 22:53:46,632 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' released barrier for procedure'testScannerOnBulkLoadRefHFiles', counting down latch. Waiting for 0 more 2023-03-11 22:53:46,632 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testScannerOnBulkLoadRefHFiles' execution completed 2023-03-11 22:53:46,632 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 22:53:46,632 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 22:53:46,632 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testScannerOnBulkLoadRefHFiles 2023-03-11 22:53:46,632 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testScannerOnBulkLoadRefHFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 22:53:46,633 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-11 22:53:46,633 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-11 22:53:46,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-11 22:53:46,633 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-11 22:53:46,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:53:46,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:53:46,633 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:53:46,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-11 22:53:46,634 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:46,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:53:46,634 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:53:46,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:53:46,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-11 22:53:46,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-11 22:53:46,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:53:46,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-11 22:53:46,635 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:46,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:46,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:53:46,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-11 22:53:46,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:46,638 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:46,638 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-03-11 22:53:46,638 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:53:46,638 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-03-11 22:53:46,638 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testScannerOnBulkLoadRefHFiles' 2023-03-11 22:53:46,638 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 22:53:46,638 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles because node does not exist (not an error) 2023-03-11 22:53:46,638 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:46,638 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:53:46,638 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:53:46,639 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testScannerOnBulkLoadRefHFiles'' to complete. (max 300000 ms per retry) 2023-03-11 22:53:46,638 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:53:46,639 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 22:53:46,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:53:46,638 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-11 22:53:46,639 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-11 22:53:46,639 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-11 22:53:46,639 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:53:46,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:53:46,739 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 22:53:46,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 22:53:46,744 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-11 22:53:46,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(143): Procedure testScannerOnBulkLoadRefHFiles was in running list but was completed. Accepting new attempt. 2023-03-11 22:53:46,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(165): Submitting procedure testScannerOnBulkLoadRefHFiles 2023-03-11 22:53:46,745 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testScannerOnBulkLoadRefHFiles' 2023-03-11 22:53:46,745 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:53:46,745 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' 2023-03-11 22:53:46,745 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testScannerOnBulkLoadRefHFiles', kicking off acquire phase on members. 2023-03-11 22:53:46,746 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-11 22:53:46,746 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-03-11 22:53:46,747 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:53:46,747 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:46,747 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:53:46,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:53:46,747 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:46,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-03-11 22:53:46,747 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 22:53:46,748 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-11 22:53:46,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 22:53:46,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-03-11 22:53:46,748 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testScannerOnBulkLoadRefHFiles 2023-03-11 22:53:46,749 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testScannerOnBulkLoadRefHFiles is still present, removing 2023-03-11 22:53:46,749 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testScannerOnBulkLoadRefHFiles 2023-03-11 22:53:46,749 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testScannerOnBulkLoadRefHFiles' with timeout 60000ms 2023-03-11 22:53:46,749 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:53:46,749 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' stage 2023-03-11 22:53:46,749 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,2,1678575223634.8bff51e742e5ddadbd357b4ea853b5d8. 2023-03-11 22:53:46,749 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,2,1678575223634.8bff51e742e5ddadbd357b4ea853b5d8. started... 2023-03-11 22:53:46,749 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-11 22:53:46,749 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 22:53:46,749 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,1,1678575223634.2bd54e0456c101f274068eb0eb037545. 2023-03-11 22:53:46,749 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,1,1678575223634.2bd54e0456c101f274068eb0eb037545. started... 2023-03-11 22:53:46,749 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8bff51e742e5ddadbd357b4ea853b5d8 2/2 column families, dataSize=90 B heapSize=752 B 2023-03-11 22:53:46,750 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 2bd54e0456c101f274068eb0eb037545: 2023-03-11 22:53:46,749 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,,1678575223634.078337168df669f0c39d86df4d8f6540. 2023-03-11 22:53:46,750 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,1,1678575223634.2bd54e0456c101f274068eb0eb037545. 2023-03-11 22:53:46,750 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,,1678575223634.078337168df669f0c39d86df4d8f6540. started... 2023-03-11 22:53:46,750 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-11 22:53:46,750 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 078337168df669f0c39d86df4d8f6540: 2023-03-11 22:53:46,750 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,,1678575223634.078337168df669f0c39d86df4d8f6540. 2023-03-11 22:53:46,750 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-11 22:53:47,177 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303114ed6799bc2c44b12a5fe12e3a5fadb8f to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202303114ed6799bc2c44b12a5fe12e3a5fadb8f 2023-03-11 22:53:47,584 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=90, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testScannerOnBulkLoadRefHFiles/8bff51e742e5ddadbd357b4ea853b5d8/.tmp/family1/20790d430b30442fa7cd29a885e53237 2023-03-11 22:53:47,600 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testScannerOnBulkLoadRefHFiles/8bff51e742e5ddadbd357b4ea853b5d8/.tmp/family1/20790d430b30442fa7cd29a885e53237 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testScannerOnBulkLoadRefHFiles/8bff51e742e5ddadbd357b4ea853b5d8/family1/20790d430b30442fa7cd29a885e53237 2023-03-11 22:53:47,605 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testScannerOnBulkLoadRefHFiles/8bff51e742e5ddadbd357b4ea853b5d8/family1/20790d430b30442fa7cd29a885e53237, entries=2, sequenceid=9, filesize=5.0 K 2023-03-11 22:53:47,606 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~90 B/90, heapSize ~480 B/480, currentSize=0 B/0 for 8bff51e742e5ddadbd357b4ea853b5d8 in 857ms, sequenceid=9, compaction requested=false 2023-03-11 22:53:47,606 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8bff51e742e5ddadbd357b4ea853b5d8: 2023-03-11 22:53:47,606 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,2,1678575223634.8bff51e742e5ddadbd357b4ea853b5d8. 2023-03-11 22:53:47,606 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-11 22:53:47,606 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-11 22:53:47,606 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:47,606 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally acquired 2023-03-11 22:53:47,606 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure (testScannerOnBulkLoadRefHFiles) in zk 2023-03-11 22:53:47,608 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:47,608 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-11 22:53:47,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:47,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:53:47,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:53:47,608 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-11 22:53:47,608 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testScannerOnBulkLoadRefHFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 22:53:47,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:53:47,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:53:47,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-11 22:53:47,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:47,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:53:47,610 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure 'testScannerOnBulkLoadRefHFiles' on coordinator 2023-03-11 22:53:47,610 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@337ade35[Count = 0] remaining members to acquire global barrier 2023-03-11 22:53:47,610 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'in-barrier' execution. 2023-03-11 22:53:47,610 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-11 22:53:47,611 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-11 22:53:47,611 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-11 22:53:47,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-11 22:53:47,611 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testScannerOnBulkLoadRefHFiles' received 'reached' from coordinator. 2023-03-11 22:53:47,611 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally completed 2023-03-11 22:53:47,611 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testScannerOnBulkLoadRefHFiles' completed for member 'jenkins-hbase20.apache.org,41843,1678575183185' in zk 2023-03-11 22:53:47,611 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:47,611 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 22:53:47,612 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testScannerOnBulkLoadRefHFiles' has notified controller of completion 2023-03-11 22:53:47,612 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:47,612 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:53:47,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:47,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:53:47,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:53:47,612 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testScannerOnBulkLoadRefHFiles' completed. 2023-03-11 22:53:47,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:53:47,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:53:47,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-11 22:53:47,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:47,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:53:47,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-11 22:53:47,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:47,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testScannerOnBulkLoadRefHFiles' member 'jenkins-hbase20.apache.org,41843,1678575183185': 2023-03-11 22:53:47,616 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' released barrier for procedure'testScannerOnBulkLoadRefHFiles', counting down latch. Waiting for 0 more 2023-03-11 22:53:47,616 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testScannerOnBulkLoadRefHFiles' execution completed 2023-03-11 22:53:47,616 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 22:53:47,616 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 22:53:47,616 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testScannerOnBulkLoadRefHFiles 2023-03-11 22:53:47,616 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testScannerOnBulkLoadRefHFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 22:53:47,617 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-11 22:53:47,617 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:53:47,617 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-11 22:53:47,617 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-11 22:53:47,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-11 22:53:47,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-11 22:53:47,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:53:47,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:53:47,618 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:53:47,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:53:47,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:53:47,618 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:47,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-11 22:53:47,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-11 22:53:47,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:53:47,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-11 22:53:47,619 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:47,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:47,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:53:47,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-11 22:53:47,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:47,620 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:47,621 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:53:47,621 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-03-11 22:53:47,621 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:53:47,621 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testScannerOnBulkLoadRefHFiles' 2023-03-11 22:53:47,621 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 22:53:47,621 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-03-11 22:53:47,621 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:47,621 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:53:47,621 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testScannerOnBulkLoadRefHFiles'' to complete. (max 300000 ms per retry) 2023-03-11 22:53:47,621 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:53:47,621 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 22:53:47,621 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles because node does not exist (not an error) 2023-03-11 22:53:47,621 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-11 22:53:47,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:53:47,621 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-11 22:53:47,621 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-11 22:53:47,622 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:53:47,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:53:47,721 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 22:53:47,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 22:53:47,733 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=44347] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testScannerOnBulkLoadRefHFiles 2023-03-11 22:53:47,736 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-03-11 22:53:47,736 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-03-11 22:53:47,737 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1678575827737 2023-03-11 22:53:47,737 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] mob.MobUtils(833): start MOB compaction of files for table='testScannerOnBulkLoadRefHFiles', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-11 22:53:47,739 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-11 22:53:47,739 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 2 selected files, and 0 irrelevant files table 'testScannerOnBulkLoadRefHFiles' and column 'family1' 2023-03-11 22:53:47,739 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-03-11 22:53:47,740 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] zookeeper.ReadOnlyZKClient(139): Connect 0x1047e347 to 127.0.0.1:51815 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-11 22:53:47,743 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@206848c5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-11 22:53:47,743 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230311 for table='testScannerOnBulkLoadRefHFiles' and column='family1' 2023-03-11 22:53:48,580 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230311ec85fb72459f4b18841f66458201a99e to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20230311ec85fb72459f4b18841f66458201a99e 2023-03-11 22:53:48,583 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230311 table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-03-11 22:53:48,597 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-11 22:53:48,598 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:39272, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-11 22:53:48,605 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-11 22:53:48,608 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:33344, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-11 22:53:48,618 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230311/family1/17db45fb0ca949e0a4720f54a676058d first=Optional[k0] last=Optional[k1] 2023-03-11 22:53:48,618 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testScannerOnBulkLoadRefHFiles,2,1678575223634.8bff51e742e5ddadbd357b4ea853b5d8., hostname=jenkins-hbase20.apache.org,41843,1678575183185, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230311/family1/17db45fb0ca949e0a4720f54a676058d}] 2023-03-11 22:53:48,624 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230311/family1/17db45fb0ca949e0a4720f54a676058d for inclusion in 8bff51e742e5ddadbd357b4ea853b5d8/family1 2023-03-11 22:53:48,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(775): HFile bounds: first=k0 last=k1 2023-03-11 22:53:48,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(777): Region bounds: first=2 last= 2023-03-11 22:53:48,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HRegion(2446): Flush status journal for 8bff51e742e5ddadbd357b4ea853b5d8: 2023-03-11 22:53:48,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230311/family1/17db45fb0ca949e0a4720f54a676058d to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testScannerOnBulkLoadRefHFiles__mrb9aega8viqb7nde1a4ll74ma733krlbl9quqhejlme6f6t7m6bkpsjfvf8b579/family1/17db45fb0ca949e0a4720f54a676058d 2023-03-11 22:53:48,630 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testScannerOnBulkLoadRefHFiles__mrb9aega8viqb7nde1a4ll74ma733krlbl9quqhejlme6f6t7m6bkpsjfvf8b579/family1/17db45fb0ca949e0a4720f54a676058d as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testScannerOnBulkLoadRefHFiles/8bff51e742e5ddadbd357b4ea853b5d8/family1/55d072b197ec48af9926da8a1432e104_SeqId_12_ 2023-03-11 22:53:48,630 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testScannerOnBulkLoadRefHFiles__mrb9aega8viqb7nde1a4ll74ma733krlbl9quqhejlme6f6t7m6bkpsjfvf8b579/family1/17db45fb0ca949e0a4720f54a676058d into 8bff51e742e5ddadbd357b4ea853b5d8/family1 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testScannerOnBulkLoadRefHFiles/8bff51e742e5ddadbd357b4ea853b5d8/family1/55d072b197ec48af9926da8a1432e104_SeqId_12_ - updating store file list. 2023-03-11 22:53:48,636 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testScannerOnBulkLoadRefHFiles/8bff51e742e5ddadbd357b4ea853b5d8/family1/55d072b197ec48af9926da8a1432e104_SeqId_12_ into 8bff51e742e5ddadbd357b4ea853b5d8/family1 2023-03-11 22:53:48,636 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testScannerOnBulkLoadRefHFiles__mrb9aega8viqb7nde1a4ll74ma733krlbl9quqhejlme6f6t7m6bkpsjfvf8b579/family1/17db45fb0ca949e0a4720f54a676058d into 8bff51e742e5ddadbd357b4ea853b5d8/family1 (new location: hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testScannerOnBulkLoadRefHFiles/8bff51e742e5ddadbd357b4ea853b5d8/family1/55d072b197ec48af9926da8a1432e104_SeqId_12_) 2023-03-11 22:53:48,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testScannerOnBulkLoadRefHFiles__mrb9aega8viqb7nde1a4ll74ma733krlbl9quqhejlme6f6t7m6bkpsjfvf8b579/family1/17db45fb0ca949e0a4720f54a676058d 2023-03-11 22:53:48,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-03-11 22:53:48,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 15445 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-03-11 22:53:48,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(1912): 8bff51e742e5ddadbd357b4ea853b5d8/family1 is initiating minor compaction (all files) 2023-03-11 22:53:48,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@33357eea; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-11 22:53:48,639 INFO [RS:0;jenkins-hbase20:41843-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 8bff51e742e5ddadbd357b4ea853b5d8/family1 in testScannerOnBulkLoadRefHFiles,2,1678575223634.8bff51e742e5ddadbd357b4ea853b5d8. 2023-03-11 22:53:48,639 INFO [RS:0;jenkins-hbase20:41843-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testScannerOnBulkLoadRefHFiles/8bff51e742e5ddadbd357b4ea853b5d8/family1/6efb42d622e64513b8616efe80fd7bd8, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testScannerOnBulkLoadRefHFiles/8bff51e742e5ddadbd357b4ea853b5d8/family1/20790d430b30442fa7cd29a885e53237, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testScannerOnBulkLoadRefHFiles/8bff51e742e5ddadbd357b4ea853b5d8/family1/55d072b197ec48af9926da8a1432e104_SeqId_12_] into tmpdir=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testScannerOnBulkLoadRefHFiles/8bff51e742e5ddadbd357b4ea853b5d8/.tmp, totalSize=15.1 K 2023-03-11 22:53:48,640 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] compactions.Compactor(207): Compacting 6efb42d622e64513b8616efe80fd7bd8, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678575225748 2023-03-11 22:53:48,641 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] compactions.Compactor(207): Compacting 20790d430b30442fa7cd29a885e53237, keycount=2, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678575225748 2023-03-11 22:53:48,641 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] compactions.Compactor(207): Compacting 55d072b197ec48af9926da8a1432e104_SeqId_12_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678575225748 2023-03-11 22:53:48,641 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230311 table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-03-11 22:53:48,642 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 22:53:48,644 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202303114ed6799bc2c44b12a5fe12e3a5fadb8f to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202303114ed6799bc2c44b12a5fe12e3a5fadb8f 2023-03-11 22:53:48,645 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202303118923e843004f43e8b23c803b8ec2aae6 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202303118923e843004f43e8b23c803b8ec2aae6 2023-03-11 22:53:48,646 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testScannerOnBulkLoadRefHFiles 2 expired mob files are deleted 2023-03-11 22:53:48,646 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230311' 2023-03-11 22:53:48,646 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230311 for table='testScannerOnBulkLoadRefHFiles' and column='family1' 2023-03-11 22:53:48,646 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] compactions.PartitionedMobCompactor(354): After compaction, there are 1 mob files. table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-03-11 22:53:48,646 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] mob.MobUtils(840): end MOB compaction of files for table='testScannerOnBulkLoadRefHFiles', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-11 22:53:48,647 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-03-11 22:53:48,650 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE in 912 msec 2023-03-11 22:53:48,653 INFO [RS:0;jenkins-hbase20:41843-shortCompactions-0] throttle.PressureAwareThroughputController(145): 8bff51e742e5ddadbd357b4ea853b5d8#family1#compaction#38 average throughput is 0.06 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-11 22:53:48,678 INFO [Listener at localhost.localdomain/41563] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testScannerOnBulkLoadRefHFiles Thread=252 (was 254), OpenFileDescriptor=604 (was 596) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=327 (was 330), ProcessCount=168 (was 168), AvailableMemoryMB=21785 (was 21787) 2023-03-11 22:53:48,690 INFO [Listener at localhost.localdomain/41563] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyPolicy Thread=252, OpenFileDescriptor=604, MaxFileDescriptor=60000, SystemLoadAverage=327, ProcessCount=168, AvailableMemoryMB=21784 2023-03-11 22:53:48,692 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testMajorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-03-11 22:53:48,693 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:48,695 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-03-11 22:53:48,695 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(697): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyPolicy" procId is: 35 2023-03-11 22:53:48,696 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-11 22:53:48,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-03-11 22:53:48,697 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/3d226077141bc04cbf67ba56ac0d4e3c 2023-03-11 22:53:48,698 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/3d226077141bc04cbf67ba56ac0d4e3c empty. 2023-03-11 22:53:48,698 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/3d226077141bc04cbf67ba56ac0d4e3c 2023-03-11 22:53:48,698 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyPolicy regions 2023-03-11 22:53:48,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-03-11 22:53:49,000 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-03-11 22:53:49,110 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/.tabledesc/.tableinfo.0000000001 2023-03-11 22:53:49,113 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => 3d226077141bc04cbf67ba56ac0d4e3c, NAME => 'testMajorCompactionWithWeeklyPolicy,,1678575228692.3d226077141bc04cbf67ba56ac0d4e3c.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/.tmp 2023-03-11 22:53:49,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-03-11 22:53:49,482 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testScannerOnBulkLoadRefHFiles/8bff51e742e5ddadbd357b4ea853b5d8/.tmp/family1/6bb25c40c72a4d3ab88a0e408fd50859 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testScannerOnBulkLoadRefHFiles/8bff51e742e5ddadbd357b4ea853b5d8/family1/6bb25c40c72a4d3ab88a0e408fd50859 2023-03-11 22:53:49,488 INFO [RS:0;jenkins-hbase20:41843-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 8bff51e742e5ddadbd357b4ea853b5d8/family1 of 8bff51e742e5ddadbd357b4ea853b5d8 into 6bb25c40c72a4d3ab88a0e408fd50859(size=5.1 K), total size for store is 5.1 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-11 22:53:49,488 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 8bff51e742e5ddadbd357b4ea853b5d8: 2023-03-11 22:53:49,488 INFO [RS:0;jenkins-hbase20:41843-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testScannerOnBulkLoadRefHFiles,2,1678575223634.8bff51e742e5ddadbd357b4ea853b5d8., storeName=family1, fileCount=3, fileSize=15.1 K (4.9 K, 5.0 K, 5.2 K), priority=2, time=1678575228639; duration=0sec 2023-03-11 22:53:49,488 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-11 22:53:49,524 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyPolicy,,1678575228692.3d226077141bc04cbf67ba56ac0d4e3c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-11 22:53:49,524 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1604): Closing 3d226077141bc04cbf67ba56ac0d4e3c, disabling compactions & flushes 2023-03-11 22:53:49,524 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyPolicy,,1678575228692.3d226077141bc04cbf67ba56ac0d4e3c. 2023-03-11 22:53:49,524 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyPolicy,,1678575228692.3d226077141bc04cbf67ba56ac0d4e3c. 2023-03-11 22:53:49,524 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyPolicy,,1678575228692.3d226077141bc04cbf67ba56ac0d4e3c. after waiting 0 ms 2023-03-11 22:53:49,524 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyPolicy,,1678575228692.3d226077141bc04cbf67ba56ac0d4e3c. 2023-03-11 22:53:49,525 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyPolicy,,1678575228692.3d226077141bc04cbf67ba56ac0d4e3c. 2023-03-11 22:53:49,525 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for 3d226077141bc04cbf67ba56ac0d4e3c: 2023-03-11 22:53:49,528 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-03-11 22:53:49,530 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyPolicy,,1678575228692.3d226077141bc04cbf67ba56ac0d4e3c.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1678575229530"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678575229530"}]},"ts":"1678575229530"} 2023-03-11 22:53:49,533 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-03-11 22:53:49,535 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-11 22:53:49,535 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678575229535"}]},"ts":"1678575229535"} 2023-03-11 22:53:49,536 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyPolicy, state=ENABLING in hbase:meta 2023-03-11 22:53:49,538 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=3d226077141bc04cbf67ba56ac0d4e3c, ASSIGN}] 2023-03-11 22:53:49,540 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=3d226077141bc04cbf67ba56ac0d4e3c, ASSIGN 2023-03-11 22:53:49,540 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=3d226077141bc04cbf67ba56ac0d4e3c, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,41843,1678575183185; forceNewPlan=false, retain=false 2023-03-11 22:53:49,579 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testScannerOnBulkLoadRefHFiles/8bff51e742e5ddadbd357b4ea853b5d8/family1/6efb42d622e64513b8616efe80fd7bd8, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testScannerOnBulkLoadRefHFiles/8bff51e742e5ddadbd357b4ea853b5d8/family1/20790d430b30442fa7cd29a885e53237, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testScannerOnBulkLoadRefHFiles/8bff51e742e5ddadbd357b4ea853b5d8/family1/55d072b197ec48af9926da8a1432e104_SeqId_12_] to archive 2023-03-11 22:53:49,580 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 22:53:49,582 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testScannerOnBulkLoadRefHFiles/8bff51e742e5ddadbd357b4ea853b5d8/family1/6efb42d622e64513b8616efe80fd7bd8 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testScannerOnBulkLoadRefHFiles/8bff51e742e5ddadbd357b4ea853b5d8/family1/6efb42d622e64513b8616efe80fd7bd8 2023-03-11 22:53:49,584 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testScannerOnBulkLoadRefHFiles/8bff51e742e5ddadbd357b4ea853b5d8/family1/20790d430b30442fa7cd29a885e53237 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testScannerOnBulkLoadRefHFiles/8bff51e742e5ddadbd357b4ea853b5d8/family1/20790d430b30442fa7cd29a885e53237 2023-03-11 22:53:49,586 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testScannerOnBulkLoadRefHFiles/8bff51e742e5ddadbd357b4ea853b5d8/family1/55d072b197ec48af9926da8a1432e104_SeqId_12_ to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testScannerOnBulkLoadRefHFiles/8bff51e742e5ddadbd357b4ea853b5d8/family1/55d072b197ec48af9926da8a1432e104_SeqId_12_ 2023-03-11 22:53:49,692 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=3d226077141bc04cbf67ba56ac0d4e3c, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:49,692 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyPolicy,,1678575228692.3d226077141bc04cbf67ba56ac0d4e3c.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1678575229692"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1678575229692"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678575229692"}]},"ts":"1678575229692"} 2023-03-11 22:53:49,695 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE; OpenRegionProcedure 3d226077141bc04cbf67ba56ac0d4e3c, server=jenkins-hbase20.apache.org,41843,1678575183185}] 2023-03-11 22:53:49,806 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-03-11 22:53:49,851 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyPolicy,,1678575228692.3d226077141bc04cbf67ba56ac0d4e3c. 2023-03-11 22:53:49,851 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3d226077141bc04cbf67ba56ac0d4e3c, NAME => 'testMajorCompactionWithWeeklyPolicy,,1678575228692.3d226077141bc04cbf67ba56ac0d4e3c.', STARTKEY => '', ENDKEY => ''} 2023-03-11 22:53:49,851 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyPolicy 3d226077141bc04cbf67ba56ac0d4e3c 2023-03-11 22:53:49,851 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyPolicy,,1678575228692.3d226077141bc04cbf67ba56ac0d4e3c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-11 22:53:49,851 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 3d226077141bc04cbf67ba56ac0d4e3c 2023-03-11 22:53:49,851 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 3d226077141bc04cbf67ba56ac0d4e3c 2023-03-11 22:53:49,853 INFO [StoreOpener-3d226077141bc04cbf67ba56ac0d4e3c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 3d226077141bc04cbf67ba56ac0d4e3c 2023-03-11 22:53:49,854 DEBUG [StoreOpener-3d226077141bc04cbf67ba56ac0d4e3c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyPolicy/3d226077141bc04cbf67ba56ac0d4e3c/family1 2023-03-11 22:53:49,854 DEBUG [StoreOpener-3d226077141bc04cbf67ba56ac0d4e3c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyPolicy/3d226077141bc04cbf67ba56ac0d4e3c/family1 2023-03-11 22:53:49,854 INFO [StoreOpener-3d226077141bc04cbf67ba56ac0d4e3c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3d226077141bc04cbf67ba56ac0d4e3c columnFamilyName family1 2023-03-11 22:53:49,856 INFO [StoreOpener-3d226077141bc04cbf67ba56ac0d4e3c-1] regionserver.HStore(310): Store=3d226077141bc04cbf67ba56ac0d4e3c/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-11 22:53:49,857 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyPolicy/3d226077141bc04cbf67ba56ac0d4e3c 2023-03-11 22:53:49,858 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyPolicy/3d226077141bc04cbf67ba56ac0d4e3c 2023-03-11 22:53:49,861 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 3d226077141bc04cbf67ba56ac0d4e3c 2023-03-11 22:53:49,863 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyPolicy/3d226077141bc04cbf67ba56ac0d4e3c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-11 22:53:49,864 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 3d226077141bc04cbf67ba56ac0d4e3c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71620963, jitterRate=0.06723551452159882}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-11 22:53:49,864 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 3d226077141bc04cbf67ba56ac0d4e3c: 2023-03-11 22:53:49,864 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyPolicy,,1678575228692.3d226077141bc04cbf67ba56ac0d4e3c., pid=37, masterSystemTime=1678575229848 2023-03-11 22:53:49,866 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyPolicy,,1678575228692.3d226077141bc04cbf67ba56ac0d4e3c. 2023-03-11 22:53:49,866 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyPolicy,,1678575228692.3d226077141bc04cbf67ba56ac0d4e3c. 2023-03-11 22:53:49,866 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=3d226077141bc04cbf67ba56ac0d4e3c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:49,867 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyPolicy,,1678575228692.3d226077141bc04cbf67ba56ac0d4e3c.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1678575229866"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1678575229866"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678575229866"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678575229866"}]},"ts":"1678575229866"} 2023-03-11 22:53:49,870 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=37, resume processing ppid=36 2023-03-11 22:53:49,870 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; OpenRegionProcedure 3d226077141bc04cbf67ba56ac0d4e3c, server=jenkins-hbase20.apache.org,41843,1678575183185 in 173 msec 2023-03-11 22:53:49,872 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=36, resume processing ppid=35 2023-03-11 22:53:49,872 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=35, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=3d226077141bc04cbf67ba56ac0d4e3c, ASSIGN in 332 msec 2023-03-11 22:53:49,873 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-11 22:53:49,873 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678575229873"}]},"ts":"1678575229873"} 2023-03-11 22:53:49,874 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyPolicy, state=ENABLED in hbase:meta 2023-03-11 22:53:49,876 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-03-11 22:53:49,877 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy in 1.1830 sec 2023-03-11 22:53:50,337 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-11 22:53:50,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-03-11 22:53:50,808 INFO [Listener at localhost.localdomain/41563] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyPolicy, procId: 35 completed 2023-03-11 22:53:50,837 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-11 22:53:50,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:50,839 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-03-11 22:53:50,839 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:53:50,839 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-11 22:53:50,839 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-11 22:53:50,840 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:50,840 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:50,840 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:53:50,840 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:50,840 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:53:50,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:53:50,841 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:50,841 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 22:53:50,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:50,841 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:50,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 22:53:50,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:50,841 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:50,842 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:50,842 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-11 22:53:50,842 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:53:50,842 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-11 22:53:50,845 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 22:53:50,845 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1678575228692.3d226077141bc04cbf67ba56ac0d4e3c. 2023-03-11 22:53:50,845 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1678575228692.3d226077141bc04cbf67ba56ac0d4e3c. started... 2023-03-11 22:53:50,845 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 22:53:50,846 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 3d226077141bc04cbf67ba56ac0d4e3c 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-03-11 22:53:50,875 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130799ee4597aab491c860c2feee3032958 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151130799ee4597aab491c860c2feee3032958 2023-03-11 22:53:51,280 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyPolicy/3d226077141bc04cbf67ba56ac0d4e3c/.tmp/family1/80c3390f15be4eea99c4d53871b40c20 2023-03-11 22:53:51,291 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyPolicy/3d226077141bc04cbf67ba56ac0d4e3c/.tmp/family1/80c3390f15be4eea99c4d53871b40c20 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyPolicy/3d226077141bc04cbf67ba56ac0d4e3c/family1/80c3390f15be4eea99c4d53871b40c20 2023-03-11 22:53:51,296 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyPolicy/3d226077141bc04cbf67ba56ac0d4e3c/family1/80c3390f15be4eea99c4d53871b40c20, entries=1000, sequenceid=5, filesize=165.1 K 2023-03-11 22:53:51,297 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 3d226077141bc04cbf67ba56ac0d4e3c in 451ms, sequenceid=5, compaction requested=false 2023-03-11 22:53:51,297 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyPolicy' 2023-03-11 22:53:51,298 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 3d226077141bc04cbf67ba56ac0d4e3c: 2023-03-11 22:53:51,298 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1678575228692.3d226077141bc04cbf67ba56ac0d4e3c. 2023-03-11 22:53:51,298 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 22:53:51,298 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 22:53:51,298 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:51,298 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-03-11 22:53:51,298 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-03-11 22:53:51,299 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:51,299 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:51,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:51,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:53:51,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:53:51,300 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:51,300 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 22:53:51,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:53:51,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:53:51,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:51,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:51,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:53:51,301 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-03-11 22:53:51,301 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4f838c75[Count = 0] remaining members to acquire global barrier 2023-03-11 22:53:51,301 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-11 22:53:51,302 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:51,302 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:51,302 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:51,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:51,302 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-11 22:53:51,302 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-03-11 22:53:51,302 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,41843,1678575183185' in zk 2023-03-11 22:53:51,302 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:51,303 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 22:53:51,303 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-11 22:53:51,304 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:53:51,304 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-03-11 22:53:51,303 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:51,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:51,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:53:51,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:53:51,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:53:51,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:53:51,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:51,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:51,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:53:51,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:51,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:51,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,41843,1678575183185': 2023-03-11 22:53:51,306 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-11 22:53:51,306 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-03-11 22:53:51,306 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 22:53:51,306 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 22:53:51,306 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:51,306 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 22:53:51,307 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:51,307 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:51,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:51,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:53:51,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:53:51,307 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:51,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:51,307 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:53:51,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:53:51,307 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:51,307 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:53:51,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:53:51,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:51,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:51,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:53:51,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:51,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:51,308 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:51,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:53:51,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:51,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:51,310 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:51,310 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:53:51,310 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:51,310 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:53:51,310 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-11 22:53:51,310 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:51,310 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-03-11 22:53:51,310 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 22:53:51,310 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:53:51,310 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:53:51,310 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:51,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:53:51,311 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-11 22:53:51,311 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 22:53:51,311 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:51,311 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:53:51,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:53:51,311 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:51,311 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:51,411 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 22:53:51,413 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 22:53:51,422 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-11 22:53:51,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-11 22:53:51,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:51,424 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-03-11 22:53:51,424 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:53:51,424 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-11 22:53:51,424 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-11 22:53:51,425 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:51,425 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:51,426 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:51,426 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:53:51,426 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:53:51,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:53:51,426 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:51,426 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 22:53:51,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:51,427 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:51,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 22:53:51,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:51,428 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:51,428 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-03-11 22:53:51,428 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:51,428 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-11 22:53:51,428 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:53:51,428 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-11 22:53:51,429 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 22:53:51,429 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 22:53:51,429 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1678575228692.3d226077141bc04cbf67ba56ac0d4e3c. 2023-03-11 22:53:51,429 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1678575228692.3d226077141bc04cbf67ba56ac0d4e3c. started... 2023-03-11 22:53:51,429 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 3d226077141bc04cbf67ba56ac0d4e3c 1/1 column families, dataSize=74 B heapSize=408 B 2023-03-11 22:53:51,856 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128d2fb72e87ee54e96ba64913a5def8740 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151128d2fb72e87ee54e96ba64913a5def8740 2023-03-11 22:53:52,264 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyPolicy/3d226077141bc04cbf67ba56ac0d4e3c/.tmp/family1/a1c700c1e1384818b6a3aa76282cf5e7 2023-03-11 22:53:52,271 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyPolicy/3d226077141bc04cbf67ba56ac0d4e3c/.tmp/family1/a1c700c1e1384818b6a3aa76282cf5e7 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyPolicy/3d226077141bc04cbf67ba56ac0d4e3c/family1/a1c700c1e1384818b6a3aa76282cf5e7 2023-03-11 22:53:52,279 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyPolicy/3d226077141bc04cbf67ba56ac0d4e3c/family1/a1c700c1e1384818b6a3aa76282cf5e7, entries=1, sequenceid=9, filesize=5.0 K 2023-03-11 22:53:52,280 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 3d226077141bc04cbf67ba56ac0d4e3c in 851ms, sequenceid=9, compaction requested=false 2023-03-11 22:53:52,281 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 3d226077141bc04cbf67ba56ac0d4e3c: 2023-03-11 22:53:52,281 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1678575228692.3d226077141bc04cbf67ba56ac0d4e3c. 2023-03-11 22:53:52,281 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 22:53:52,281 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 22:53:52,281 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:52,281 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-03-11 22:53:52,281 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-03-11 22:53:52,282 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:52,282 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:52,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:52,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:53:52,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:53:52,283 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:52,283 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 22:53:52,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:53:52,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:53:52,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:52,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:52,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:53:52,285 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-03-11 22:53:52,285 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4dd3b33b[Count = 0] remaining members to acquire global barrier 2023-03-11 22:53:52,285 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-11 22:53:52,286 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:52,287 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:52,288 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:52,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:52,288 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-11 22:53:52,288 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-03-11 22:53:52,288 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,41843,1678575183185' in zk 2023-03-11 22:53:52,288 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:52,288 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 22:53:52,289 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:52,289 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-11 22:53:52,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:52,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:53:52,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:53:52,289 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:53:52,289 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-03-11 22:53:52,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:53:52,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:53:52,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:52,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:52,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:53:52,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:52,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:52,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,41843,1678575183185': 2023-03-11 22:53:52,292 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-11 22:53:52,292 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-03-11 22:53:52,292 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 22:53:52,292 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 22:53:52,293 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:52,293 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 22:53:52,294 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:52,294 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:52,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:52,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:53:52,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:53:52,294 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:52,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:52,294 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:53:52,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:53:52,295 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:53:52,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:53:52,295 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:52,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:52,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:52,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:53:52,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:52,297 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:52,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:52,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:53:52,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:52,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:52,299 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:52,299 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:52,299 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:52,299 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:53:52,299 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:53:52,300 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-11 22:53:52,299 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:52,300 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:52,300 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:52,300 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:52,299 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:53:52,299 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-03-11 22:53:52,300 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 22:53:52,299 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:53:52,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:53:52,300 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-11 22:53:52,301 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 22:53:52,301 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:53:52,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:53:52,401 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 22:53:52,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 22:53:52,413 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-11 22:53:52,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-11 22:53:52,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:52,416 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-03-11 22:53:52,416 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:53:52,416 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-11 22:53:52,416 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-11 22:53:52,417 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:52,417 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:52,418 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:53:52,418 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:52,418 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:53:52,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:53:52,419 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:52,419 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 22:53:52,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:52,419 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:52,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 22:53:52,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:52,420 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:52,420 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-03-11 22:53:52,421 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:52,421 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-11 22:53:52,421 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:53:52,421 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-11 22:53:52,421 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 22:53:52,421 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 22:53:52,421 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1678575228692.3d226077141bc04cbf67ba56ac0d4e3c. 2023-03-11 22:53:52,421 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1678575228692.3d226077141bc04cbf67ba56ac0d4e3c. started... 2023-03-11 22:53:52,421 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 3d226077141bc04cbf67ba56ac0d4e3c 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-11 22:53:52,844 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201079522936e674ad5bd9487a9f09c73c7 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151201079522936e674ad5bd9487a9f09c73c7 2023-03-11 22:53:53,252 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyPolicy/3d226077141bc04cbf67ba56ac0d4e3c/.tmp/family1/9c22775ccbee47cb81082e792f843c5f 2023-03-11 22:53:53,264 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyPolicy/3d226077141bc04cbf67ba56ac0d4e3c/.tmp/family1/9c22775ccbee47cb81082e792f843c5f as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyPolicy/3d226077141bc04cbf67ba56ac0d4e3c/family1/9c22775ccbee47cb81082e792f843c5f 2023-03-11 22:53:53,270 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyPolicy/3d226077141bc04cbf67ba56ac0d4e3c/family1/9c22775ccbee47cb81082e792f843c5f, entries=1, sequenceid=13, filesize=4.9 K 2023-03-11 22:53:53,271 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 3d226077141bc04cbf67ba56ac0d4e3c in 850ms, sequenceid=13, compaction requested=true 2023-03-11 22:53:53,271 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 3d226077141bc04cbf67ba56ac0d4e3c: 2023-03-11 22:53:53,271 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1678575228692.3d226077141bc04cbf67ba56ac0d4e3c. 2023-03-11 22:53:53,271 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 22:53:53,271 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 22:53:53,271 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:53,271 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-03-11 22:53:53,271 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-03-11 22:53:53,273 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:53,273 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:53,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:53,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:53:53,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:53:53,273 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:53,273 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 22:53:53,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:53:53,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:53:53,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:53,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:53,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:53:53,276 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-03-11 22:53:53,276 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@265656db[Count = 0] remaining members to acquire global barrier 2023-03-11 22:53:53,276 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-11 22:53:53,276 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:53,277 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:53,277 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:53,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:53,277 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-11 22:53:53,277 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-03-11 22:53:53,277 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:53,277 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 22:53:53,277 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,41843,1678575183185' in zk 2023-03-11 22:53:53,278 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-11 22:53:53,278 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:53,278 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:53:53,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:53,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:53:53,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:53:53,278 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-03-11 22:53:53,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:53:53,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:53:53,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:53,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:53,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:53:53,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:53,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:53,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,41843,1678575183185': 2023-03-11 22:53:53,282 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-11 22:53:53,282 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-03-11 22:53:53,282 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 22:53:53,282 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 22:53:53,282 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:53,282 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 22:53:53,284 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:53,284 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:53,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:53,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:53:53,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:53:53,284 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:53,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:53,284 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:53:53,284 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:53:53,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:53:53,284 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:53,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:53:53,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:53,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:53,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:53:53,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:53,286 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:53,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:53,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:53:53,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:53,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:53,288 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:53,288 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:53:53,288 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:53,289 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:53:53,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:53:53,289 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:53:53,289 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-03-11 22:53:53,289 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 22:53:53,289 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:53:53,289 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:53,289 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:53,289 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:53,289 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:53:53,289 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:53,289 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-11 22:53:53,290 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 22:53:53,289 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-11 22:53:53,289 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:53,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:53:53,390 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 22:53:53,392 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 22:53:53,401 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-11 22:53:53,404 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-11 22:53:53,404 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:53,404 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-03-11 22:53:53,404 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:53:53,404 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-11 22:53:53,404 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-11 22:53:53,405 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:53,405 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:53,406 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:53,406 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:53:53,406 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:53:53,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:53:53,407 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:53,407 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 22:53:53,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:53,408 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:53,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 22:53:53,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:53,408 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:53,409 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-03-11 22:53:53,409 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:53,409 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-11 22:53:53,409 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:53:53,409 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-11 22:53:53,409 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 22:53:53,409 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 22:53:53,409 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1678575228692.3d226077141bc04cbf67ba56ac0d4e3c. 2023-03-11 22:53:53,410 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1678575228692.3d226077141bc04cbf67ba56ac0d4e3c. started... 2023-03-11 22:53:53,410 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 3d226077141bc04cbf67ba56ac0d4e3c 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-11 22:53:53,835 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512054eb3e8e729cc454083a17f17b167e8ab to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512054eb3e8e729cc454083a17f17b167e8ab 2023-03-11 22:53:54,245 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyPolicy/3d226077141bc04cbf67ba56ac0d4e3c/.tmp/family1/ec09596d61ed4ea397c516bd5885afd3 2023-03-11 22:53:54,256 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyPolicy/3d226077141bc04cbf67ba56ac0d4e3c/.tmp/family1/ec09596d61ed4ea397c516bd5885afd3 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyPolicy/3d226077141bc04cbf67ba56ac0d4e3c/family1/ec09596d61ed4ea397c516bd5885afd3 2023-03-11 22:53:54,263 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyPolicy/3d226077141bc04cbf67ba56ac0d4e3c/family1/ec09596d61ed4ea397c516bd5885afd3, entries=1, sequenceid=17, filesize=4.9 K 2023-03-11 22:53:54,264 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 3d226077141bc04cbf67ba56ac0d4e3c in 854ms, sequenceid=17, compaction requested=true 2023-03-11 22:53:54,264 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 3d226077141bc04cbf67ba56ac0d4e3c: 2023-03-11 22:53:54,264 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1678575228692.3d226077141bc04cbf67ba56ac0d4e3c. 2023-03-11 22:53:54,264 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 22:53:54,264 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 22:53:54,264 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:54,264 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-03-11 22:53:54,264 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-03-11 22:53:54,265 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:54,266 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:54,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:54,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:53:54,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:53:54,266 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:54,266 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 22:53:54,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:53:54,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:53:54,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:54,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:54,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:53:54,267 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-03-11 22:53:54,268 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4338af52[Count = 0] remaining members to acquire global barrier 2023-03-11 22:53:54,268 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-11 22:53:54,268 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:54,268 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:54,268 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:54,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:54,269 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-11 22:53:54,269 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-03-11 22:53:54,269 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:54,269 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 22:53:54,269 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,41843,1678575183185' in zk 2023-03-11 22:53:54,269 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:54,269 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-11 22:53:54,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:54,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:53:54,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:53:54,270 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:53:54,270 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-03-11 22:53:54,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:53:54,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:53:54,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:54,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:54,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:53:54,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:54,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:54,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,41843,1678575183185': 2023-03-11 22:53:54,272 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-11 22:53:54,272 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-03-11 22:53:54,272 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 22:53:54,272 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 22:53:54,272 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:54,272 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 22:53:54,273 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:54,273 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:54,273 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:53:54,273 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:54,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:54,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:54,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:53:54,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:53:54,273 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:53:54,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:53:54,273 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:54,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:53:54,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:54,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:54,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:53:54,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:54,274 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:54,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:54,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:53:54,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:54,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:54,276 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:54,276 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:53:54,276 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:54,276 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-03-11 22:53:54,276 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 22:53:54,276 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:54,276 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:54,276 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:54,276 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:54,276 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:54,276 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:53:54,276 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:53:54,276 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-11 22:53:54,276 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:53:54,276 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 22:53:54,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:53:54,276 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-11 22:53:54,277 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:53:54,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:53:54,376 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 22:53:54,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 22:53:54,387 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-11 22:53:54,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-11 22:53:54,391 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:54,391 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-03-11 22:53:54,391 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:53:54,391 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-11 22:53:54,391 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-11 22:53:54,392 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:54,392 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:54,394 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:53:54,394 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:54,394 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:53:54,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:53:54,394 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:54,394 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 22:53:54,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:54,395 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:54,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 22:53:54,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:54,396 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:54,396 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-03-11 22:53:54,396 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:54,396 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-11 22:53:54,396 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:53:54,396 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-11 22:53:54,396 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 22:53:54,397 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 22:53:54,397 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1678575228692.3d226077141bc04cbf67ba56ac0d4e3c. 2023-03-11 22:53:54,397 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1678575228692.3d226077141bc04cbf67ba56ac0d4e3c. started... 2023-03-11 22:53:54,397 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 3d226077141bc04cbf67ba56ac0d4e3c 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-11 22:53:54,820 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228c647a741ed6747c7be5df3234ec3dcfb to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151228c647a741ed6747c7be5df3234ec3dcfb 2023-03-11 22:53:55,229 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyPolicy/3d226077141bc04cbf67ba56ac0d4e3c/.tmp/family1/e580dd0290f44ec7b9dfd9190e3b4d2d 2023-03-11 22:53:55,242 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyPolicy/3d226077141bc04cbf67ba56ac0d4e3c/.tmp/family1/e580dd0290f44ec7b9dfd9190e3b4d2d as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyPolicy/3d226077141bc04cbf67ba56ac0d4e3c/family1/e580dd0290f44ec7b9dfd9190e3b4d2d 2023-03-11 22:53:55,248 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyPolicy/3d226077141bc04cbf67ba56ac0d4e3c/family1/e580dd0290f44ec7b9dfd9190e3b4d2d, entries=1, sequenceid=21, filesize=4.9 K 2023-03-11 22:53:55,248 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 3d226077141bc04cbf67ba56ac0d4e3c in 851ms, sequenceid=21, compaction requested=true 2023-03-11 22:53:55,249 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 3d226077141bc04cbf67ba56ac0d4e3c: 2023-03-11 22:53:55,249 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1678575228692.3d226077141bc04cbf67ba56ac0d4e3c. 2023-03-11 22:53:55,249 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 22:53:55,249 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 22:53:55,249 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:55,249 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-03-11 22:53:55,249 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-03-11 22:53:55,250 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:55,250 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:55,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:55,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:53:55,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:53:55,251 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:55,251 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 22:53:55,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:53:55,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:53:55,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:55,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:55,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:53:55,252 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-03-11 22:53:55,253 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@100b7364[Count = 0] remaining members to acquire global barrier 2023-03-11 22:53:55,253 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-11 22:53:55,253 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:55,253 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:55,253 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:55,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:55,254 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-11 22:53:55,254 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-03-11 22:53:55,254 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,41843,1678575183185' in zk 2023-03-11 22:53:55,254 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:55,254 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 22:53:55,255 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-11 22:53:55,255 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:55,255 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:53:55,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:55,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:53:55,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:53:55,255 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-03-11 22:53:55,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:53:55,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:53:55,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:55,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:55,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:53:55,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:55,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:55,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,41843,1678575183185': 2023-03-11 22:53:55,258 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-11 22:53:55,258 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-03-11 22:53:55,258 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 22:53:55,258 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 22:53:55,258 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:55,258 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 22:53:55,271 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:55,271 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:55,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:55,271 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:55,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:55,271 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:53:55,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:53:55,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:53:55,271 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:53:55,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:53:55,272 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:55,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:53:55,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:55,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:55,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:53:55,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:55,274 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:55,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:55,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:53:55,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:55,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:55,279 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:55,279 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:55,279 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:53:55,279 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:55,279 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-03-11 22:53:55,279 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 22:53:55,279 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:53:55,279 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:53:55,279 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:53:55,280 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-11 22:53:55,280 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 22:53:55,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:53:55,279 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:55,280 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:55,280 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:55,280 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:55,280 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-11 22:53:55,281 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:53:55,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:53:55,356 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-11 22:53:55,380 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 22:53:55,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 22:53:55,385 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-11 22:53:55,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-11 22:53:55,387 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:55,387 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-03-11 22:53:55,387 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:53:55,387 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-11 22:53:55,387 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-11 22:53:55,387 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:55,387 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:55,388 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:53:55,388 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:55,388 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:53:55,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:53:55,388 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:55,388 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 22:53:55,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:55,389 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:55,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 22:53:55,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:55,389 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:55,389 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-03-11 22:53:55,389 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:55,389 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-11 22:53:55,389 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:53:55,389 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-11 22:53:55,389 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 22:53:55,389 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 22:53:55,389 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1678575228692.3d226077141bc04cbf67ba56ac0d4e3c. 2023-03-11 22:53:55,390 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1678575228692.3d226077141bc04cbf67ba56ac0d4e3c. started... 2023-03-11 22:53:55,390 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 3d226077141bc04cbf67ba56ac0d4e3c 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-11 22:53:55,807 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512310e88f37c8de147279d3e4f6b3d41200c to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512310e88f37c8de147279d3e4f6b3d41200c 2023-03-11 22:53:56,216 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyPolicy/3d226077141bc04cbf67ba56ac0d4e3c/.tmp/family1/8793d45a3c884e7687c3b75584ae22f1 2023-03-11 22:53:56,231 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyPolicy/3d226077141bc04cbf67ba56ac0d4e3c/.tmp/family1/8793d45a3c884e7687c3b75584ae22f1 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyPolicy/3d226077141bc04cbf67ba56ac0d4e3c/family1/8793d45a3c884e7687c3b75584ae22f1 2023-03-11 22:53:56,236 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyPolicy/3d226077141bc04cbf67ba56ac0d4e3c/family1/8793d45a3c884e7687c3b75584ae22f1, entries=1, sequenceid=25, filesize=4.9 K 2023-03-11 22:53:56,236 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 3d226077141bc04cbf67ba56ac0d4e3c in 846ms, sequenceid=25, compaction requested=true 2023-03-11 22:53:56,236 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 3d226077141bc04cbf67ba56ac0d4e3c: 2023-03-11 22:53:56,237 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1678575228692.3d226077141bc04cbf67ba56ac0d4e3c. 2023-03-11 22:53:56,237 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 22:53:56,237 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 22:53:56,237 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:56,237 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-03-11 22:53:56,237 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-03-11 22:53:56,238 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:56,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:56,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:53:56,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:53:56,238 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:56,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:53:56,239 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:56,239 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 22:53:56,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:53:56,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:56,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:56,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:53:56,240 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-03-11 22:53:56,240 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@40115035[Count = 0] remaining members to acquire global barrier 2023-03-11 22:53:56,240 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-11 22:53:56,240 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:56,240 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:56,240 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:56,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:56,240 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-11 22:53:56,241 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-03-11 22:53:56,241 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,41843,1678575183185' in zk 2023-03-11 22:53:56,241 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:56,241 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 22:53:56,242 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-11 22:53:56,242 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:56,242 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:53:56,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:56,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:53:56,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:53:56,242 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-03-11 22:53:56,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:53:56,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:53:56,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:56,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:56,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:53:56,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:56,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:56,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,41843,1678575183185': 2023-03-11 22:53:56,245 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-11 22:53:56,245 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-03-11 22:53:56,245 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 22:53:56,245 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 22:53:56,245 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:56,245 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 22:53:56,246 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:56,246 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:56,246 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:56,246 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:53:56,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:56,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:56,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:53:56,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:53:56,247 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:53:56,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:53:56,247 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:56,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:53:56,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:56,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:56,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:53:56,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:56,248 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:56,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:56,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:53:56,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:56,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:56,250 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:56,251 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:53:56,251 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:56,251 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:53:56,251 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-03-11 22:53:56,251 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 22:53:56,251 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:53:56,251 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-11 22:53:56,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:53:56,251 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-11 22:53:56,251 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 22:53:56,251 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:53:56,251 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:56,251 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:53:56,252 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:56,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:53:56,252 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:56,252 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:56,252 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:56,352 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 22:53:56,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 22:53:56,362 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-11 22:53:56,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-11 22:53:56,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:56,366 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-03-11 22:53:56,366 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:53:56,366 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-11 22:53:56,366 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-11 22:53:56,367 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:56,367 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:56,368 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:53:56,368 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:56,368 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:53:56,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:53:56,369 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:56,369 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 22:53:56,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:56,370 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:56,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 22:53:56,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:56,371 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:56,371 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-03-11 22:53:56,371 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:56,371 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-11 22:53:56,371 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:53:56,371 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-11 22:53:56,371 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 22:53:56,372 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 22:53:56,372 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1678575228692.3d226077141bc04cbf67ba56ac0d4e3c. 2023-03-11 22:53:56,372 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1678575228692.3d226077141bc04cbf67ba56ac0d4e3c. started... 2023-03-11 22:53:56,372 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 3d226077141bc04cbf67ba56ac0d4e3c 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-11 22:53:56,799 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101dcc854d5d7e7497a8a84580dca1b6a46 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160101dcc854d5d7e7497a8a84580dca1b6a46 2023-03-11 22:53:57,206 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyPolicy/3d226077141bc04cbf67ba56ac0d4e3c/.tmp/family1/69e4cac2af23464eb5e222146957b7a4 2023-03-11 22:53:57,218 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyPolicy/3d226077141bc04cbf67ba56ac0d4e3c/.tmp/family1/69e4cac2af23464eb5e222146957b7a4 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyPolicy/3d226077141bc04cbf67ba56ac0d4e3c/family1/69e4cac2af23464eb5e222146957b7a4 2023-03-11 22:53:57,222 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyPolicy/3d226077141bc04cbf67ba56ac0d4e3c/family1/69e4cac2af23464eb5e222146957b7a4, entries=1, sequenceid=29, filesize=4.9 K 2023-03-11 22:53:57,223 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 3d226077141bc04cbf67ba56ac0d4e3c in 851ms, sequenceid=29, compaction requested=true 2023-03-11 22:53:57,223 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 3d226077141bc04cbf67ba56ac0d4e3c: 2023-03-11 22:53:57,223 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1678575228692.3d226077141bc04cbf67ba56ac0d4e3c. 2023-03-11 22:53:57,223 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 22:53:57,223 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 22:53:57,223 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:57,223 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-03-11 22:53:57,223 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-03-11 22:53:57,226 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:57,226 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:57,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:57,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:53:57,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:53:57,227 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:57,227 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 22:53:57,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:53:57,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:53:57,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:57,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:57,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:53:57,228 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-03-11 22:53:57,228 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@54653662[Count = 0] remaining members to acquire global barrier 2023-03-11 22:53:57,228 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-11 22:53:57,228 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:57,228 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:57,228 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:57,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:57,229 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-11 22:53:57,229 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:57,229 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 22:53:57,229 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-03-11 22:53:57,229 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,41843,1678575183185' in zk 2023-03-11 22:53:57,229 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-11 22:53:57,229 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:57,230 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:53:57,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:57,230 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-03-11 22:53:57,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:53:57,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:53:57,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:53:57,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:53:57,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:57,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:57,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:53:57,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:57,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:57,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,41843,1678575183185': 2023-03-11 22:53:57,231 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-11 22:53:57,231 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-03-11 22:53:57,232 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 22:53:57,232 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 22:53:57,232 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:57,232 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 22:53:57,232 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:57,232 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:57,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:57,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:53:57,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:53:57,232 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:57,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:57,232 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:53:57,233 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:57,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:53:57,233 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:53:57,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:53:57,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:57,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:57,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:53:57,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:57,234 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:57,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:57,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:53:57,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:57,236 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:57,236 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:53:57,236 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:57,236 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:53:57,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:53:57,236 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-03-11 22:53:57,236 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 22:53:57,236 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:57,236 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:53:57,236 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:53:57,236 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:57,236 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-11 22:53:57,236 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-11 22:53:57,236 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:57,236 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 22:53:57,236 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:53:57,236 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:57,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:53:57,236 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:57,336 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 22:53:57,338 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 22:53:57,347 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-11 22:53:57,350 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-11 22:53:57,350 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:57,350 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-03-11 22:53:57,350 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:53:57,350 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-11 22:53:57,350 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-11 22:53:57,351 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:57,351 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:57,352 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:57,352 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:53:57,353 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:53:57,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:53:57,353 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:57,353 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 22:53:57,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:57,354 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:57,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 22:53:57,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:57,355 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:57,355 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-03-11 22:53:57,355 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:57,355 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-11 22:53:57,355 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:53:57,355 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-11 22:53:57,355 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 22:53:57,356 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 22:53:57,356 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1678575228692.3d226077141bc04cbf67ba56ac0d4e3c. 2023-03-11 22:53:57,356 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1678575228692.3d226077141bc04cbf67ba56ac0d4e3c. started... 2023-03-11 22:53:57,356 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 3d226077141bc04cbf67ba56ac0d4e3c 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-11 22:53:57,782 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103816a40236dc7446e8e74979c3a3d6a1b to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103816a40236dc7446e8e74979c3a3d6a1b 2023-03-11 22:53:58,192 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyPolicy/3d226077141bc04cbf67ba56ac0d4e3c/.tmp/family1/d391ebf583d34b92b99867f2128f1ed2 2023-03-11 22:53:58,202 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyPolicy/3d226077141bc04cbf67ba56ac0d4e3c/.tmp/family1/d391ebf583d34b92b99867f2128f1ed2 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyPolicy/3d226077141bc04cbf67ba56ac0d4e3c/family1/d391ebf583d34b92b99867f2128f1ed2 2023-03-11 22:53:58,207 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyPolicy/3d226077141bc04cbf67ba56ac0d4e3c/family1/d391ebf583d34b92b99867f2128f1ed2, entries=1, sequenceid=33, filesize=4.9 K 2023-03-11 22:53:58,208 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 3d226077141bc04cbf67ba56ac0d4e3c in 852ms, sequenceid=33, compaction requested=true 2023-03-11 22:53:58,208 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 3d226077141bc04cbf67ba56ac0d4e3c: 2023-03-11 22:53:58,208 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1678575228692.3d226077141bc04cbf67ba56ac0d4e3c. 2023-03-11 22:53:58,208 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 22:53:58,208 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 22:53:58,208 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:58,208 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-03-11 22:53:58,208 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-03-11 22:53:58,209 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:58,209 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:58,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:58,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:53:58,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:53:58,209 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:58,209 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 22:53:58,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:53:58,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:53:58,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:58,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:58,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:53:58,210 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-03-11 22:53:58,210 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@52215183[Count = 0] remaining members to acquire global barrier 2023-03-11 22:53:58,210 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-11 22:53:58,210 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:58,211 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:58,211 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:58,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:58,211 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-11 22:53:58,211 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-03-11 22:53:58,211 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,41843,1678575183185' in zk 2023-03-11 22:53:58,211 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:58,211 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 22:53:58,212 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-11 22:53:58,212 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:58,212 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:53:58,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:58,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:53:58,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:53:58,212 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-03-11 22:53:58,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:53:58,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:53:58,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:58,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:58,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:53:58,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:58,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:58,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,41843,1678575183185': 2023-03-11 22:53:58,214 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-11 22:53:58,214 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-03-11 22:53:58,214 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 22:53:58,214 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 22:53:58,214 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:58,214 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 22:53:58,215 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:58,215 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:58,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:58,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:53:58,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:53:58,215 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:58,215 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:53:58,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:58,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:53:58,215 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:53:58,215 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:58,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:58,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:53:58,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:53:58,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:58,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:58,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:58,216 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:58,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:53:58,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:58,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:58,217 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:58,217 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:53:58,217 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:53:58,217 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:58,217 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-03-11 22:53:58,217 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 22:53:58,217 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:53:58,217 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:53:58,218 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-11 22:53:58,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:53:58,217 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:58,218 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 22:53:58,218 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:58,218 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:58,218 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:58,218 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:53:58,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:53:58,218 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:58,318 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 22:53:58,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 22:53:58,325 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-11 22:53:58,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-11 22:53:58,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:58,327 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-03-11 22:53:58,327 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:53:58,328 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-11 22:53:58,328 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-11 22:53:58,328 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:58,328 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:58,329 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:53:58,330 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:58,330 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:53:58,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:53:58,330 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:58,330 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 22:53:58,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:58,331 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:58,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 22:53:58,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:58,332 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:58,333 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-03-11 22:53:58,333 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:58,333 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-11 22:53:58,333 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:53:58,333 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-11 22:53:58,333 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 22:53:58,333 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 22:53:58,333 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1678575228692.3d226077141bc04cbf67ba56ac0d4e3c. 2023-03-11 22:53:58,334 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1678575228692.3d226077141bc04cbf67ba56ac0d4e3c. started... 2023-03-11 22:53:58,334 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 3d226077141bc04cbf67ba56ac0d4e3c 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-11 22:53:58,760 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509073c6d3f39ef3848bb88024ce2b956f84e to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201509073c6d3f39ef3848bb88024ce2b956f84e 2023-03-11 22:53:59,169 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyPolicy/3d226077141bc04cbf67ba56ac0d4e3c/.tmp/family1/5a4293ed529e43468b6312367e17c964 2023-03-11 22:53:59,179 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyPolicy/3d226077141bc04cbf67ba56ac0d4e3c/.tmp/family1/5a4293ed529e43468b6312367e17c964 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyPolicy/3d226077141bc04cbf67ba56ac0d4e3c/family1/5a4293ed529e43468b6312367e17c964 2023-03-11 22:53:59,185 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyPolicy/3d226077141bc04cbf67ba56ac0d4e3c/family1/5a4293ed529e43468b6312367e17c964, entries=1, sequenceid=37, filesize=4.9 K 2023-03-11 22:53:59,186 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 3d226077141bc04cbf67ba56ac0d4e3c in 852ms, sequenceid=37, compaction requested=true 2023-03-11 22:53:59,186 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 3d226077141bc04cbf67ba56ac0d4e3c: 2023-03-11 22:53:59,186 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1678575228692.3d226077141bc04cbf67ba56ac0d4e3c. 2023-03-11 22:53:59,187 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 22:53:59,187 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 22:53:59,187 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:59,187 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-03-11 22:53:59,187 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-03-11 22:53:59,188 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:59,188 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:59,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:59,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:53:59,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:53:59,189 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:59,189 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 22:53:59,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:53:59,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:53:59,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:59,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:59,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:53:59,191 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-03-11 22:53:59,191 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@19fa88f0[Count = 0] remaining members to acquire global barrier 2023-03-11 22:53:59,191 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-11 22:53:59,191 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:59,191 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:59,191 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:59,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:59,192 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-11 22:53:59,192 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-03-11 22:53:59,192 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,41843,1678575183185' in zk 2023-03-11 22:53:59,192 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:59,192 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 22:53:59,193 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:59,193 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-11 22:53:59,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:59,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:53:59,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:53:59,193 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:53:59,193 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-03-11 22:53:59,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:53:59,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:53:59,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:59,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:59,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:53:59,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:59,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:59,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,41843,1678575183185': 2023-03-11 22:53:59,195 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-11 22:53:59,195 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-03-11 22:53:59,195 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 22:53:59,195 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 22:53:59,195 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:59,195 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 22:53:59,195 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:59,195 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:59,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:59,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:53:59,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:53:59,195 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:59,195 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:53:59,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:59,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:53:59,196 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:59,196 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:53:59,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:53:59,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:59,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:59,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:53:59,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:59,196 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:59,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:59,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:53:59,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:59,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:59,198 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:59,198 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:59,198 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:53:59,198 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:59,198 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:53:59,198 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-11 22:53:59,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:53:59,198 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:59,198 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-03-11 22:53:59,198 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 22:53:59,198 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:53:59,198 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:53:59,198 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:59,198 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:53:59,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:53:59,198 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:59,198 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-11 22:53:59,198 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:59,198 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 22:53:59,299 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 22:53:59,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 22:53:59,311 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-11 22:53:59,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-11 22:53:59,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:59,315 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-03-11 22:53:59,315 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:53:59,315 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-11 22:53:59,315 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-11 22:53:59,315 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:59,315 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:59,316 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:59,316 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:53:59,316 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:53:59,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:53:59,317 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:53:59,317 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 22:53:59,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:59,317 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:59,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 22:53:59,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:59,318 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:59,318 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-03-11 22:53:59,318 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-03-11 22:53:59,318 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-11 22:53:59,318 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:53:59,318 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-11 22:53:59,319 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 22:53:59,319 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 22:53:59,319 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1678575228692.3d226077141bc04cbf67ba56ac0d4e3c. 2023-03-11 22:53:59,319 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1678575228692.3d226077141bc04cbf67ba56ac0d4e3c. started... 2023-03-11 22:53:59,319 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 3d226077141bc04cbf67ba56ac0d4e3c 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-11 22:53:59,739 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120b0f6d5f288d84d4c92349798f59bd655 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151120b0f6d5f288d84d4c92349798f59bd655 2023-03-11 22:54:00,146 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyPolicy/3d226077141bc04cbf67ba56ac0d4e3c/.tmp/family1/4a8aa03b5401485da62a2cb0a0975ae1 2023-03-11 22:54:00,153 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyPolicy/3d226077141bc04cbf67ba56ac0d4e3c/.tmp/family1/4a8aa03b5401485da62a2cb0a0975ae1 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyPolicy/3d226077141bc04cbf67ba56ac0d4e3c/family1/4a8aa03b5401485da62a2cb0a0975ae1 2023-03-11 22:54:00,158 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyPolicy/3d226077141bc04cbf67ba56ac0d4e3c/family1/4a8aa03b5401485da62a2cb0a0975ae1, entries=1, sequenceid=41, filesize=4.9 K 2023-03-11 22:54:00,159 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 3d226077141bc04cbf67ba56ac0d4e3c in 840ms, sequenceid=41, compaction requested=true 2023-03-11 22:54:00,159 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 3d226077141bc04cbf67ba56ac0d4e3c: 2023-03-11 22:54:00,159 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1678575228692.3d226077141bc04cbf67ba56ac0d4e3c. 2023-03-11 22:54:00,159 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 22:54:00,159 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 22:54:00,159 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:00,159 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-03-11 22:54:00,159 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-03-11 22:54:00,161 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:00,161 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:54:00,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:00,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:54:00,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:54:00,161 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:54:00,161 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 22:54:00,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:54:00,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:54:00,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-11 22:54:00,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:00,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:54:00,162 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-03-11 22:54:00,162 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@53a0f302[Count = 0] remaining members to acquire global barrier 2023-03-11 22:54:00,162 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-11 22:54:00,162 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:54:00,163 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:54:00,163 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:54:00,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:54:00,163 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-11 22:54:00,163 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-03-11 22:54:00,163 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,41843,1678575183185' in zk 2023-03-11 22:54:00,163 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:00,164 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 22:54:00,164 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:00,165 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-11 22:54:00,165 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:54:00,165 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-03-11 22:54:00,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:00,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:54:00,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:54:00,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:54:00,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:54:00,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-11 22:54:00,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:00,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:54:00,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-11 22:54:00,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:00,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,41843,1678575183185': 2023-03-11 22:54:00,169 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-11 22:54:00,169 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-03-11 22:54:00,169 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 22:54:00,169 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 22:54:00,169 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-03-11 22:54:00,170 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 22:54:00,179 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:54:00,179 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:54:00,179 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:54:00,179 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:54:00,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:54:00,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:54:00,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:54:00,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:54:00,179 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:54:00,179 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:00,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:54:00,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:54:00,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-11 22:54:00,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:54:00,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:54:00,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-11 22:54:00,180 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:00,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:00,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:54:00,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-11 22:54:00,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:00,183 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:00,183 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:54:00,183 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:54:00,183 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-03-11 22:54:00,183 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 22:54:00,183 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:54:00,183 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-11 22:54:00,183 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:54:00,183 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:54:00,183 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-11 22:54:00,183 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:54:00,183 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 22:54:00,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:54:00,183 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:00,184 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:54:00,184 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:54:00,184 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-11 22:54:00,184 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:54:00,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:54:00,284 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 22:54:00,284 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 22:54:00,286 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=44347] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyPolicy 2023-03-11 22:54:00,288 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] procedure2.ProcedureExecutor(1029): Stored pid=38, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-03-11 22:54:00,289 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=38, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-03-11 22:54:00,289 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-11 22:54:00,289 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=38, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1678575840289 2023-03-11 22:54:00,293 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-11 22:54:00,294 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyPolicy' and column 'family1' 2023-03-11 22:54:00,294 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-03-11 22:54:00,294 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] zookeeper.ReadOnlyZKClient(139): Connect 0x185f4f66 to 127.0.0.1:51815 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-11 22:54:00,300 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1a50b06c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-11 22:54:00,301 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-03-11 22:54:01,145 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103c08a056a9c77401f85e6a9def3f8fdcd to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103c08a056a9c77401f85e6a9def3f8fdcd 2023-03-11 22:54:01,146 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-03-11 22:54:01,160 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-11 22:54:01,161 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:49802, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-11 22:54:01,169 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-11 22:54:01,170 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:36686, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-11 22:54:01,178 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/0563ae0614ee4845a33d294cb55244d8 first=Optional[r3] last=Optional[r6] 2023-03-11 22:54:01,179 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyPolicy,,1678575228692.3d226077141bc04cbf67ba56ac0d4e3c., hostname=jenkins-hbase20.apache.org,41843,1678575183185, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/0563ae0614ee4845a33d294cb55244d8}] 2023-03-11 22:54:01,185 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/0563ae0614ee4845a33d294cb55244d8 for inclusion in 3d226077141bc04cbf67ba56ac0d4e3c/family1 2023-03-11 22:54:01,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-03-11 22:54:01,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(777): Region bounds: first= last= 2023-03-11 22:54:01,188 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HRegion(2446): Flush status journal for 3d226077141bc04cbf67ba56ac0d4e3c: 2023-03-11 22:54:01,188 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/0563ae0614ee4845a33d294cb55244d8 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testMajorCompactionWithWeeklyPolicy__2alhregbkhl7723khln3h0kj5rktkidd171093u2d7b1k1iq2ki9ca1mgg8vnv6/family1/0563ae0614ee4845a33d294cb55244d8 2023-03-11 22:54:01,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testMajorCompactionWithWeeklyPolicy__2alhregbkhl7723khln3h0kj5rktkidd171093u2d7b1k1iq2ki9ca1mgg8vnv6/family1/0563ae0614ee4845a33d294cb55244d8 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyPolicy/3d226077141bc04cbf67ba56ac0d4e3c/family1/7392c08f381a4067a7e86e7687bff2b7_SeqId_44_ 2023-03-11 22:54:01,191 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testMajorCompactionWithWeeklyPolicy__2alhregbkhl7723khln3h0kj5rktkidd171093u2d7b1k1iq2ki9ca1mgg8vnv6/family1/0563ae0614ee4845a33d294cb55244d8 into 3d226077141bc04cbf67ba56ac0d4e3c/family1 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyPolicy/3d226077141bc04cbf67ba56ac0d4e3c/family1/7392c08f381a4067a7e86e7687bff2b7_SeqId_44_ - updating store file list. 2023-03-11 22:54:01,195 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyPolicy/3d226077141bc04cbf67ba56ac0d4e3c/family1/7392c08f381a4067a7e86e7687bff2b7_SeqId_44_ into 3d226077141bc04cbf67ba56ac0d4e3c/family1 2023-03-11 22:54:01,196 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testMajorCompactionWithWeeklyPolicy__2alhregbkhl7723khln3h0kj5rktkidd171093u2d7b1k1iq2ki9ca1mgg8vnv6/family1/0563ae0614ee4845a33d294cb55244d8 into 3d226077141bc04cbf67ba56ac0d4e3c/family1 (new location: hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyPolicy/3d226077141bc04cbf67ba56ac0d4e3c/family1/7392c08f381a4067a7e86e7687bff2b7_SeqId_44_) 2023-03-11 22:54:01,196 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testMajorCompactionWithWeeklyPolicy__2alhregbkhl7723khln3h0kj5rktkidd171093u2d7b1k1iq2ki9ca1mgg8vnv6/family1/0563ae0614ee4845a33d294cb55244d8 2023-03-11 22:54:01,196 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-03-11 22:54:01,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51214 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-03-11 22:54:01,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(1912): 3d226077141bc04cbf67ba56ac0d4e3c/family1 is initiating minor compaction 2023-03-11 22:54:01,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@1e81c744; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-03-11 22:54:01,200 INFO [RS:0;jenkins-hbase20:41843-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 3d226077141bc04cbf67ba56ac0d4e3c/family1 in testMajorCompactionWithWeeklyPolicy,,1678575228692.3d226077141bc04cbf67ba56ac0d4e3c. 2023-03-11 22:54:01,200 INFO [RS:0;jenkins-hbase20:41843-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyPolicy/3d226077141bc04cbf67ba56ac0d4e3c/family1/a1c700c1e1384818b6a3aa76282cf5e7, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyPolicy/3d226077141bc04cbf67ba56ac0d4e3c/family1/9c22775ccbee47cb81082e792f843c5f, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyPolicy/3d226077141bc04cbf67ba56ac0d4e3c/family1/ec09596d61ed4ea397c516bd5885afd3, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyPolicy/3d226077141bc04cbf67ba56ac0d4e3c/family1/e580dd0290f44ec7b9dfd9190e3b4d2d, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyPolicy/3d226077141bc04cbf67ba56ac0d4e3c/family1/8793d45a3c884e7687c3b75584ae22f1, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyPolicy/3d226077141bc04cbf67ba56ac0d4e3c/family1/69e4cac2af23464eb5e222146957b7a4, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyPolicy/3d226077141bc04cbf67ba56ac0d4e3c/family1/d391ebf583d34b92b99867f2128f1ed2, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyPolicy/3d226077141bc04cbf67ba56ac0d4e3c/family1/5a4293ed529e43468b6312367e17c964, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyPolicy/3d226077141bc04cbf67ba56ac0d4e3c/family1/4a8aa03b5401485da62a2cb0a0975ae1, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyPolicy/3d226077141bc04cbf67ba56ac0d4e3c/family1/7392c08f381a4067a7e86e7687bff2b7_SeqId_44_] into tmpdir=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyPolicy/3d226077141bc04cbf67ba56ac0d4e3c/.tmp, totalSize=50.0 K 2023-03-11 22:54:01,200 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] compactions.Compactor(207): Compacting a1c700c1e1384818b6a3aa76282cf5e7, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-03-11 22:54:01,200 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] compactions.Compactor(207): Compacting 9c22775ccbee47cb81082e792f843c5f, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-03-11 22:54:01,200 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] compactions.Compactor(207): Compacting ec09596d61ed4ea397c516bd5885afd3, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-03-11 22:54:01,200 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] compactions.Compactor(207): Compacting e580dd0290f44ec7b9dfd9190e3b4d2d, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-03-11 22:54:01,200 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] compactions.Compactor(207): Compacting 8793d45a3c884e7687c3b75584ae22f1, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-03-11 22:54:01,200 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] compactions.Compactor(207): Compacting 69e4cac2af23464eb5e222146957b7a4, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-03-11 22:54:01,200 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] compactions.Compactor(207): Compacting d391ebf583d34b92b99867f2128f1ed2, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-03-11 22:54:01,200 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] compactions.Compactor(207): Compacting 5a4293ed529e43468b6312367e17c964, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-03-11 22:54:01,200 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] compactions.Compactor(207): Compacting 4a8aa03b5401485da62a2cb0a0975ae1, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-03-11 22:54:01,200 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] compactions.Compactor(207): Compacting 7392c08f381a4067a7e86e7687bff2b7_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-03-11 22:54:01,201 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-03-11 22:54:01,202 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 22:54:01,204 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151228c647a741ed6747c7be5df3234ec3dcfb to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151228c647a741ed6747c7be5df3234ec3dcfb 2023-03-11 22:54:01,205 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512310e88f37c8de147279d3e4f6b3d41200c to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512310e88f37c8de147279d3e4f6b3d41200c 2023-03-11 22:54:01,206 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160101dcc854d5d7e7497a8a84580dca1b6a46 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160101dcc854d5d7e7497a8a84580dca1b6a46 2023-03-11 22:54:01,207 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103816a40236dc7446e8e74979c3a3d6a1b to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103816a40236dc7446e8e74979c3a3d6a1b 2023-03-11 22:54:01,207 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyPolicy 4 expired mob files are deleted 2023-03-11 22:54:01,207 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-03-11 22:54:01,208 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-03-11 22:54:01,208 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-03-11 22:54:01,208 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-03-11 22:54:01,208 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-03-11 22:54:01,208 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-03-11 22:54:01,208 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-03-11 22:54:01,208 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-03-11 22:54:01,208 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-03-11 22:54:01,242 INFO [RS:0;jenkins-hbase20:41843-shortCompactions-0] throttle.PressureAwareThroughputController(145): 3d226077141bc04cbf67ba56ac0d4e3c#family1#compaction#49 average throughput is 0.68 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-11 22:54:01,274 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-11 22:54:01,274 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1047e347 to 127.0.0.1:51815 2023-03-11 22:54:01,274 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-11 22:54:01,274 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-11 22:54:01,274 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6354346e to 127.0.0.1:51815 2023-03-11 22:54:01,274 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-11 22:54:01,663 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyPolicy/3d226077141bc04cbf67ba56ac0d4e3c/.tmp/family1/4555f58351dc4b55a3e232e9440fa382 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyPolicy/3d226077141bc04cbf67ba56ac0d4e3c/family1/4555f58351dc4b55a3e232e9440fa382 2023-03-11 22:54:01,668 INFO [RS:0;jenkins-hbase20:41843-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 3d226077141bc04cbf67ba56ac0d4e3c/family1 of 3d226077141bc04cbf67ba56ac0d4e3c into 4555f58351dc4b55a3e232e9440fa382(size=6.6 K), total size for store is 171.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-11 22:54:01,668 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 3d226077141bc04cbf67ba56ac0d4e3c: 2023-03-11 22:54:01,668 INFO [RS:0;jenkins-hbase20:41843-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyPolicy,,1678575228692.3d226077141bc04cbf67ba56ac0d4e3c., storeName=family1, fileCount=10, fileSize=50.0 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.5 K), priority=2, time=1678575241199; duration=0sec 2023-03-11 22:54:01,668 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-11 22:54:01,779 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyPolicy/3d226077141bc04cbf67ba56ac0d4e3c/family1/a1c700c1e1384818b6a3aa76282cf5e7, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyPolicy/3d226077141bc04cbf67ba56ac0d4e3c/family1/9c22775ccbee47cb81082e792f843c5f, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyPolicy/3d226077141bc04cbf67ba56ac0d4e3c/family1/ec09596d61ed4ea397c516bd5885afd3, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyPolicy/3d226077141bc04cbf67ba56ac0d4e3c/family1/e580dd0290f44ec7b9dfd9190e3b4d2d, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyPolicy/3d226077141bc04cbf67ba56ac0d4e3c/family1/8793d45a3c884e7687c3b75584ae22f1, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyPolicy/3d226077141bc04cbf67ba56ac0d4e3c/family1/69e4cac2af23464eb5e222146957b7a4, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyPolicy/3d226077141bc04cbf67ba56ac0d4e3c/family1/d391ebf583d34b92b99867f2128f1ed2, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyPolicy/3d226077141bc04cbf67ba56ac0d4e3c/family1/5a4293ed529e43468b6312367e17c964, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyPolicy/3d226077141bc04cbf67ba56ac0d4e3c/family1/4a8aa03b5401485da62a2cb0a0975ae1, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyPolicy/3d226077141bc04cbf67ba56ac0d4e3c/family1/7392c08f381a4067a7e86e7687bff2b7_SeqId_44_] to archive 2023-03-11 22:54:01,780 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 22:54:01,781 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyPolicy/3d226077141bc04cbf67ba56ac0d4e3c/family1/a1c700c1e1384818b6a3aa76282cf5e7 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionWithWeeklyPolicy/3d226077141bc04cbf67ba56ac0d4e3c/family1/a1c700c1e1384818b6a3aa76282cf5e7 2023-03-11 22:54:01,783 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyPolicy/3d226077141bc04cbf67ba56ac0d4e3c/family1/9c22775ccbee47cb81082e792f843c5f to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionWithWeeklyPolicy/3d226077141bc04cbf67ba56ac0d4e3c/family1/9c22775ccbee47cb81082e792f843c5f 2023-03-11 22:54:01,784 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyPolicy/3d226077141bc04cbf67ba56ac0d4e3c/family1/ec09596d61ed4ea397c516bd5885afd3 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionWithWeeklyPolicy/3d226077141bc04cbf67ba56ac0d4e3c/family1/ec09596d61ed4ea397c516bd5885afd3 2023-03-11 22:54:01,785 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyPolicy/3d226077141bc04cbf67ba56ac0d4e3c/family1/e580dd0290f44ec7b9dfd9190e3b4d2d to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionWithWeeklyPolicy/3d226077141bc04cbf67ba56ac0d4e3c/family1/e580dd0290f44ec7b9dfd9190e3b4d2d 2023-03-11 22:54:01,786 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyPolicy/3d226077141bc04cbf67ba56ac0d4e3c/family1/8793d45a3c884e7687c3b75584ae22f1 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionWithWeeklyPolicy/3d226077141bc04cbf67ba56ac0d4e3c/family1/8793d45a3c884e7687c3b75584ae22f1 2023-03-11 22:54:01,787 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyPolicy/3d226077141bc04cbf67ba56ac0d4e3c/family1/69e4cac2af23464eb5e222146957b7a4 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionWithWeeklyPolicy/3d226077141bc04cbf67ba56ac0d4e3c/family1/69e4cac2af23464eb5e222146957b7a4 2023-03-11 22:54:01,788 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyPolicy/3d226077141bc04cbf67ba56ac0d4e3c/family1/d391ebf583d34b92b99867f2128f1ed2 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionWithWeeklyPolicy/3d226077141bc04cbf67ba56ac0d4e3c/family1/d391ebf583d34b92b99867f2128f1ed2 2023-03-11 22:54:01,789 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyPolicy/3d226077141bc04cbf67ba56ac0d4e3c/family1/5a4293ed529e43468b6312367e17c964 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionWithWeeklyPolicy/3d226077141bc04cbf67ba56ac0d4e3c/family1/5a4293ed529e43468b6312367e17c964 2023-03-11 22:54:01,790 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyPolicy/3d226077141bc04cbf67ba56ac0d4e3c/family1/4a8aa03b5401485da62a2cb0a0975ae1 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionWithWeeklyPolicy/3d226077141bc04cbf67ba56ac0d4e3c/family1/4a8aa03b5401485da62a2cb0a0975ae1 2023-03-11 22:54:01,791 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyPolicy/3d226077141bc04cbf67ba56ac0d4e3c/family1/7392c08f381a4067a7e86e7687bff2b7_SeqId_44_ to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionWithWeeklyPolicy/3d226077141bc04cbf67ba56ac0d4e3c/family1/7392c08f381a4067a7e86e7687bff2b7_SeqId_44_ 2023-03-11 22:54:02,095 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512056376546676924f56a41f6cc78fbb9af5 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512056376546676924f56a41f6cc78fbb9af5 2023-03-11 22:54:02,098 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-03-11 22:54:02,128 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/ccaddd473c2b41fd9cc5e1d0d8bbead6 first=Optional[r00] last=Optional[r2] 2023-03-11 22:54:02,129 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyPolicy,,1678575228692.3d226077141bc04cbf67ba56ac0d4e3c., hostname=jenkins-hbase20.apache.org,41843,1678575183185, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/ccaddd473c2b41fd9cc5e1d0d8bbead6}] 2023-03-11 22:54:02,131 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/ccaddd473c2b41fd9cc5e1d0d8bbead6 for inclusion in 3d226077141bc04cbf67ba56ac0d4e3c/family1 2023-03-11 22:54:02,134 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-03-11 22:54:02,135 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(777): Region bounds: first= last= 2023-03-11 22:54:02,135 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HRegion(2446): Flush status journal for 3d226077141bc04cbf67ba56ac0d4e3c: 2023-03-11 22:54:02,136 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/ccaddd473c2b41fd9cc5e1d0d8bbead6 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testMajorCompactionWithWeeklyPolicy__95jth7la84rsftu0ctknl1apumk6i97o512q0s7denlsn26vbdoa3hnivfi3lkio/family1/ccaddd473c2b41fd9cc5e1d0d8bbead6 2023-03-11 22:54:02,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testMajorCompactionWithWeeklyPolicy__95jth7la84rsftu0ctknl1apumk6i97o512q0s7denlsn26vbdoa3hnivfi3lkio/family1/ccaddd473c2b41fd9cc5e1d0d8bbead6 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyPolicy/3d226077141bc04cbf67ba56ac0d4e3c/family1/02197928b53c4636a211b2f063fcc1b1_SeqId_47_ 2023-03-11 22:54:02,138 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testMajorCompactionWithWeeklyPolicy__95jth7la84rsftu0ctknl1apumk6i97o512q0s7denlsn26vbdoa3hnivfi3lkio/family1/ccaddd473c2b41fd9cc5e1d0d8bbead6 into 3d226077141bc04cbf67ba56ac0d4e3c/family1 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyPolicy/3d226077141bc04cbf67ba56ac0d4e3c/family1/02197928b53c4636a211b2f063fcc1b1_SeqId_47_ - updating store file list. 2023-03-11 22:54:02,142 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyPolicy/3d226077141bc04cbf67ba56ac0d4e3c/family1/02197928b53c4636a211b2f063fcc1b1_SeqId_47_ into 3d226077141bc04cbf67ba56ac0d4e3c/family1 2023-03-11 22:54:02,143 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testMajorCompactionWithWeeklyPolicy__95jth7la84rsftu0ctknl1apumk6i97o512q0s7denlsn26vbdoa3hnivfi3lkio/family1/ccaddd473c2b41fd9cc5e1d0d8bbead6 into 3d226077141bc04cbf67ba56ac0d4e3c/family1 (new location: hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyPolicy/3d226077141bc04cbf67ba56ac0d4e3c/family1/02197928b53c4636a211b2f063fcc1b1_SeqId_47_) 2023-03-11 22:54:02,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testMajorCompactionWithWeeklyPolicy__95jth7la84rsftu0ctknl1apumk6i97o512q0s7denlsn26vbdoa3hnivfi3lkio/family1/ccaddd473c2b41fd9cc5e1d0d8bbead6 2023-03-11 22:54:02,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-03-11 22:54:02,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 345120 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-03-11 22:54:02,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(1912): 3d226077141bc04cbf67ba56ac0d4e3c/family1 is initiating minor compaction (all files) 2023-03-11 22:54:02,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@62d0ae3c; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-11 22:54:02,144 INFO [RS:0;jenkins-hbase20:41843-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 3d226077141bc04cbf67ba56ac0d4e3c/family1 in testMajorCompactionWithWeeklyPolicy,,1678575228692.3d226077141bc04cbf67ba56ac0d4e3c. 2023-03-11 22:54:02,144 INFO [RS:0;jenkins-hbase20:41843-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyPolicy/3d226077141bc04cbf67ba56ac0d4e3c/family1/80c3390f15be4eea99c4d53871b40c20, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyPolicy/3d226077141bc04cbf67ba56ac0d4e3c/family1/4555f58351dc4b55a3e232e9440fa382, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyPolicy/3d226077141bc04cbf67ba56ac0d4e3c/family1/02197928b53c4636a211b2f063fcc1b1_SeqId_47_] into tmpdir=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyPolicy/3d226077141bc04cbf67ba56ac0d4e3c/.tmp, totalSize=337.0 K 2023-03-11 22:54:02,145 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] compactions.Compactor(207): Compacting 80c3390f15be4eea99c4d53871b40c20, keycount=1000, bloomtype=ROW, size=165.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878807597 2023-03-11 22:54:02,145 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] compactions.Compactor(207): Compacting 4555f58351dc4b55a3e232e9440fa382, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621207597 2023-03-11 22:54:02,145 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] compactions.Compactor(207): Compacting 02197928b53c4636a211b2f063fcc1b1_SeqId_47_, keycount=1002, bloomtype=ROW, size=165.4 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878807597 2023-03-11 22:54:02,146 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-03-11 22:54:02,146 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 22:54:02,148 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151130799ee4597aab491c860c2feee3032958 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151130799ee4597aab491c860c2feee3032958 2023-03-11 22:54:02,149 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151201079522936e674ad5bd9487a9f09c73c7 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151201079522936e674ad5bd9487a9f09c73c7 2023-03-11 22:54:02,150 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512054eb3e8e729cc454083a17f17b167e8ab to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512054eb3e8e729cc454083a17f17b167e8ab 2023-03-11 22:54:02,150 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyPolicy 3 expired mob files are deleted 2023-03-11 22:54:02,150 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-03-11 22:54:02,151 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-03-11 22:54:02,151 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-03-11 22:54:02,151 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-11 22:54:02,152 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=38, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-03-11 22:54:02,153 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=38, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE in 1.8650 sec 2023-03-11 22:54:02,169 INFO [RS:0;jenkins-hbase20:41843-shortCompactions-0] throttle.PressureAwareThroughputController(145): 3d226077141bc04cbf67ba56ac0d4e3c#family1#compaction#50 average throughput is 11.05 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-11 22:54:02,265 INFO [Listener at localhost.localdomain/41563] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyPolicy Thread=251 (was 252), OpenFileDescriptor=604 (was 604), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=254 (was 327), ProcessCount=168 (was 168), AvailableMemoryMB=21645 (was 21784) 2023-03-11 22:54:02,276 INFO [Listener at localhost.localdomain/41563] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly Thread=251, OpenFileDescriptor=604, MaxFileDescriptor=60000, SystemLoadAverage=254, ProcessCount=168, AvailableMemoryMB=21644 2023-03-11 22:54:02,278 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-03-11 22:54:02,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure2.ProcedureExecutor(1029): Stored pid=39, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:02,281 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_PRE_OPERATION 2023-03-11 22:54:02,281 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(697): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly" procId is: 39 2023-03-11 22:54:02,282 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-11 22:54:02,282 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-03-11 22:54:02,283 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76 2023-03-11 22:54:02,284 DEBUG [HFileArchiver-9] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76 empty. 2023-03-11 22:54:02,284 DEBUG [HFileArchiver-9] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76 2023-03-11 22:54:02,284 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly regions 2023-03-11 22:54:02,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-03-11 22:54:02,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-03-11 22:54:02,693 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000001 2023-03-11 22:54:02,695 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(7675): creating {ENCODED => aa39ddf65a193cbb3b88f447adacec76, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678575242278.aa39ddf65a193cbb3b88f447adacec76.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/.tmp 2023-03-11 22:54:02,884 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-03-11 22:54:03,104 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678575242278.aa39ddf65a193cbb3b88f447adacec76.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-11 22:54:03,104 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1604): Closing aa39ddf65a193cbb3b88f447adacec76, disabling compactions & flushes 2023-03-11 22:54:03,104 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678575242278.aa39ddf65a193cbb3b88f447adacec76. 2023-03-11 22:54:03,104 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678575242278.aa39ddf65a193cbb3b88f447adacec76. 2023-03-11 22:54:03,104 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678575242278.aa39ddf65a193cbb3b88f447adacec76. after waiting 0 ms 2023-03-11 22:54:03,104 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678575242278.aa39ddf65a193cbb3b88f447adacec76. 2023-03-11 22:54:03,104 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678575242278.aa39ddf65a193cbb3b88f447adacec76. 2023-03-11 22:54:03,104 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1558): Region close journal for aa39ddf65a193cbb3b88f447adacec76: 2023-03-11 22:54:03,106 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_ADD_TO_META 2023-03-11 22:54:03,107 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678575242278.aa39ddf65a193cbb3b88f447adacec76.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1678575243107"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678575243107"}]},"ts":"1678575243107"} 2023-03-11 22:54:03,108 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-03-11 22:54:03,109 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-11 22:54:03,109 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678575243109"}]},"ts":"1678575243109"} 2023-03-11 22:54:03,110 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, state=ENABLING in hbase:meta 2023-03-11 22:54:03,112 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=aa39ddf65a193cbb3b88f447adacec76, ASSIGN}] 2023-03-11 22:54:03,113 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=aa39ddf65a193cbb3b88f447adacec76, ASSIGN 2023-03-11 22:54:03,114 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=aa39ddf65a193cbb3b88f447adacec76, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,41843,1678575183185; forceNewPlan=false, retain=false 2023-03-11 22:54:03,265 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=aa39ddf65a193cbb3b88f447adacec76, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:03,265 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678575242278.aa39ddf65a193cbb3b88f447adacec76.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1678575243265"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1678575243265"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678575243265"}]},"ts":"1678575243265"} 2023-03-11 22:54:03,267 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=41, ppid=40, state=RUNNABLE; OpenRegionProcedure aa39ddf65a193cbb3b88f447adacec76, server=jenkins-hbase20.apache.org,41843,1678575183185}] 2023-03-11 22:54:03,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-03-11 22:54:03,391 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyPolicy/3d226077141bc04cbf67ba56ac0d4e3c/.tmp/family1/048ece02322b487b885d8795067efce2 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyPolicy/3d226077141bc04cbf67ba56ac0d4e3c/family1/048ece02322b487b885d8795067efce2 2023-03-11 22:54:03,396 INFO [RS:0;jenkins-hbase20:41843-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 3d226077141bc04cbf67ba56ac0d4e3c/family1 of 3d226077141bc04cbf67ba56ac0d4e3c into 048ece02322b487b885d8795067efce2(size=166.4 K), total size for store is 166.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-11 22:54:03,396 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 3d226077141bc04cbf67ba56ac0d4e3c: 2023-03-11 22:54:03,396 INFO [RS:0;jenkins-hbase20:41843-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyPolicy,,1678575228692.3d226077141bc04cbf67ba56ac0d4e3c., storeName=family1, fileCount=3, fileSize=337.0 K (165.1 K, 6.6 K, 165.4 K), priority=2, time=1678575242144; duration=1sec 2023-03-11 22:54:03,396 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-11 22:54:03,423 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678575242278.aa39ddf65a193cbb3b88f447adacec76. 2023-03-11 22:54:03,423 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => aa39ddf65a193cbb3b88f447adacec76, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678575242278.aa39ddf65a193cbb3b88f447adacec76.', STARTKEY => '', ENDKEY => ''} 2023-03-11 22:54:03,424 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly aa39ddf65a193cbb3b88f447adacec76 2023-03-11 22:54:03,424 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678575242278.aa39ddf65a193cbb3b88f447adacec76.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-11 22:54:03,424 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for aa39ddf65a193cbb3b88f447adacec76 2023-03-11 22:54:03,425 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for aa39ddf65a193cbb3b88f447adacec76 2023-03-11 22:54:03,430 INFO [StoreOpener-aa39ddf65a193cbb3b88f447adacec76-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region aa39ddf65a193cbb3b88f447adacec76 2023-03-11 22:54:03,431 DEBUG [StoreOpener-aa39ddf65a193cbb3b88f447adacec76-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76/family1 2023-03-11 22:54:03,431 DEBUG [StoreOpener-aa39ddf65a193cbb3b88f447adacec76-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76/family1 2023-03-11 22:54:03,432 INFO [StoreOpener-aa39ddf65a193cbb3b88f447adacec76-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region aa39ddf65a193cbb3b88f447adacec76 columnFamilyName family1 2023-03-11 22:54:03,433 INFO [StoreOpener-aa39ddf65a193cbb3b88f447adacec76-1] regionserver.HStore(310): Store=aa39ddf65a193cbb3b88f447adacec76/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-11 22:54:03,433 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76 2023-03-11 22:54:03,434 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76 2023-03-11 22:54:03,435 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for aa39ddf65a193cbb3b88f447adacec76 2023-03-11 22:54:03,437 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-11 22:54:03,437 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened aa39ddf65a193cbb3b88f447adacec76; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68733668, jitterRate=0.024211466312408447}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-11 22:54:03,437 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for aa39ddf65a193cbb3b88f447adacec76: 2023-03-11 22:54:03,438 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678575242278.aa39ddf65a193cbb3b88f447adacec76., pid=41, masterSystemTime=1678575243419 2023-03-11 22:54:03,439 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678575242278.aa39ddf65a193cbb3b88f447adacec76. 2023-03-11 22:54:03,439 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678575242278.aa39ddf65a193cbb3b88f447adacec76. 2023-03-11 22:54:03,440 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=aa39ddf65a193cbb3b88f447adacec76, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:03,440 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678575242278.aa39ddf65a193cbb3b88f447adacec76.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1678575243439"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1678575243439"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678575243439"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678575243439"}]},"ts":"1678575243439"} 2023-03-11 22:54:03,442 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=41, resume processing ppid=40 2023-03-11 22:54:03,442 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=40, state=SUCCESS; OpenRegionProcedure aa39ddf65a193cbb3b88f447adacec76, server=jenkins-hbase20.apache.org,41843,1678575183185 in 174 msec 2023-03-11 22:54:03,444 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=39 2023-03-11 22:54:03,444 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=39, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=aa39ddf65a193cbb3b88f447adacec76, ASSIGN in 330 msec 2023-03-11 22:54:03,445 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-11 22:54:03,445 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678575243445"}]},"ts":"1678575243445"} 2023-03-11 22:54:03,446 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, state=ENABLED in hbase:meta 2023-03-11 22:54:03,447 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_POST_OPERATION 2023-03-11 22:54:03,449 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=39, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.1690 sec 2023-03-11 22:54:03,466 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyPolicy/3d226077141bc04cbf67ba56ac0d4e3c/family1/80c3390f15be4eea99c4d53871b40c20, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyPolicy/3d226077141bc04cbf67ba56ac0d4e3c/family1/4555f58351dc4b55a3e232e9440fa382, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyPolicy/3d226077141bc04cbf67ba56ac0d4e3c/family1/02197928b53c4636a211b2f063fcc1b1_SeqId_47_] to archive 2023-03-11 22:54:03,467 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 22:54:03,469 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyPolicy/3d226077141bc04cbf67ba56ac0d4e3c/family1/80c3390f15be4eea99c4d53871b40c20 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionWithWeeklyPolicy/3d226077141bc04cbf67ba56ac0d4e3c/family1/80c3390f15be4eea99c4d53871b40c20 2023-03-11 22:54:03,470 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyPolicy/3d226077141bc04cbf67ba56ac0d4e3c/family1/4555f58351dc4b55a3e232e9440fa382 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionWithWeeklyPolicy/3d226077141bc04cbf67ba56ac0d4e3c/family1/4555f58351dc4b55a3e232e9440fa382 2023-03-11 22:54:03,471 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyPolicy/3d226077141bc04cbf67ba56ac0d4e3c/family1/02197928b53c4636a211b2f063fcc1b1_SeqId_47_ to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionWithWeeklyPolicy/3d226077141bc04cbf67ba56ac0d4e3c/family1/02197928b53c4636a211b2f063fcc1b1_SeqId_47_ 2023-03-11 22:54:04,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-03-11 22:54:04,386 INFO [Listener at localhost.localdomain/41563] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, procId: 39 completed 2023-03-11 22:54:04,410 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-11 22:54:04,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:04,414 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-11 22:54:04,414 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:54:04,414 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-03-11 22:54:04,414 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-03-11 22:54:04,414 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:04,414 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:04,415 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:54:04,415 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:04,415 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:54:04,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:54:04,415 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:04,415 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 22:54:04,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:04,415 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:04,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 22:54:04,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:04,416 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:04,416 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:04,416 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-03-11 22:54:04,416 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:54:04,416 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-03-11 22:54:04,417 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 22:54:04,417 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 22:54:04,417 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678575242278.aa39ddf65a193cbb3b88f447adacec76. 2023-03-11 22:54:04,417 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678575242278.aa39ddf65a193cbb3b88f447adacec76. started... 2023-03-11 22:54:04,417 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing aa39ddf65a193cbb3b88f447adacec76 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-03-11 22:54:04,545 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-11 22:54:04,582 DEBUG [regionserver/jenkins-hbase20:0.Chore.1] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.0, tune throughput to 50.00 MB/second 2023-03-11 22:54:04,835 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015113043df3f40e19e415ca2db7b174ae58cb3 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015113043df3f40e19e415ca2db7b174ae58cb3 2023-03-11 22:54:05,239 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76/.tmp/family1/c51dc9e6cf6d4ed480c2fcec3c9ed9db 2023-03-11 22:54:05,245 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76/.tmp/family1/c51dc9e6cf6d4ed480c2fcec3c9ed9db as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76/family1/c51dc9e6cf6d4ed480c2fcec3c9ed9db 2023-03-11 22:54:05,250 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76/family1/c51dc9e6cf6d4ed480c2fcec3c9ed9db, entries=1000, sequenceid=5, filesize=191.4 K 2023-03-11 22:54:05,258 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for aa39ddf65a193cbb3b88f447adacec76 in 840ms, sequenceid=5, compaction requested=false 2023-03-11 22:54:05,258 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for aa39ddf65a193cbb3b88f447adacec76: 2023-03-11 22:54:05,258 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678575242278.aa39ddf65a193cbb3b88f447adacec76. 2023-03-11 22:54:05,258 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 22:54:05,258 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 22:54:05,259 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:05,259 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-03-11 22:54:05,259 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-03-11 22:54:05,260 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:05,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:05,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:54:05,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:54:05,261 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:05,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:54:05,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:54:05,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:05,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:05,262 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:05,262 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 22:54:05,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:54:05,262 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-03-11 22:54:05,263 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2e8b0932[Count = 0] remaining members to acquire global barrier 2023-03-11 22:54:05,263 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-03-11 22:54:05,263 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:05,264 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:05,264 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:05,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:05,264 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-03-11 22:54:05,264 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-03-11 22:54:05,264 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,41843,1678575183185' in zk 2023-03-11 22:54:05,264 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:05,265 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 22:54:05,266 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:05,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:05,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:54:05,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:54:05,266 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-03-11 22:54:05,266 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:54:05,266 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-03-11 22:54:05,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:54:05,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:54:05,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:05,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:05,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:54:05,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:05,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:05,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,41843,1678575183185': 2023-03-11 22:54:05,269 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-03-11 22:54:05,269 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-03-11 22:54:05,269 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 22:54:05,269 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 22:54:05,269 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:05,269 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 22:54:05,270 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:05,271 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:54:05,271 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:05,271 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:05,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:05,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:05,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:54:05,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:54:05,271 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:54:05,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:54:05,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:54:05,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:05,272 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:05,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:05,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:54:05,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:05,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:05,273 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:05,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:54:05,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:05,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:05,274 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:54:05,275 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:54:05,275 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:54:05,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:54:05,275 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:05,275 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:05,275 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:05,275 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:05,275 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:05,275 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-03-11 22:54:05,275 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-11 22:54:05,275 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 22:54:05,275 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:54:05,275 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:05,275 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:05,275 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:54:05,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:54:05,275 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-03-11 22:54:05,275 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 22:54:05,376 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 22:54:05,377 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 22:54:05,381 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-11 22:54:05,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-03-11 22:54:05,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:05,382 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-11 22:54:05,383 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:54:05,383 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-03-11 22:54:05,383 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-03-11 22:54:05,383 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:05,383 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:05,384 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:05,384 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:54:05,384 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:54:05,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:54:05,384 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:05,384 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 22:54:05,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:05,384 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:05,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 22:54:05,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:05,385 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:05,385 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-03-11 22:54:05,385 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:05,385 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-03-11 22:54:05,385 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:54:05,385 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-03-11 22:54:05,385 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 22:54:05,385 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 22:54:05,385 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678575242278.aa39ddf65a193cbb3b88f447adacec76. 2023-03-11 22:54:05,385 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678575242278.aa39ddf65a193cbb3b88f447adacec76. started... 2023-03-11 22:54:05,385 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing aa39ddf65a193cbb3b88f447adacec76 1/1 column families, dataSize=74 B heapSize=408 B 2023-03-11 22:54:05,801 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128c7a9c9343cfe4ac0a2e84a65eca88fd7 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128c7a9c9343cfe4ac0a2e84a65eca88fd7 2023-03-11 22:54:06,208 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76/.tmp/family1/3a040208e66f4d9ba9c0b80de86a38c3 2023-03-11 22:54:06,213 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76/.tmp/family1/3a040208e66f4d9ba9c0b80de86a38c3 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76/family1/3a040208e66f4d9ba9c0b80de86a38c3 2023-03-11 22:54:06,219 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76/family1/3a040208e66f4d9ba9c0b80de86a38c3, entries=1, sequenceid=9, filesize=5.0 K 2023-03-11 22:54:06,219 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for aa39ddf65a193cbb3b88f447adacec76 in 834ms, sequenceid=9, compaction requested=false 2023-03-11 22:54:06,219 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for aa39ddf65a193cbb3b88f447adacec76: 2023-03-11 22:54:06,220 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678575242278.aa39ddf65a193cbb3b88f447adacec76. 2023-03-11 22:54:06,220 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 22:54:06,220 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 22:54:06,220 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:06,220 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-03-11 22:54:06,220 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-03-11 22:54:06,221 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:06,221 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:06,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:06,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:54:06,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:54:06,221 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:06,221 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 22:54:06,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:54:06,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:54:06,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:06,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:06,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:54:06,223 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-03-11 22:54:06,223 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@76fef829[Count = 0] remaining members to acquire global barrier 2023-03-11 22:54:06,223 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-03-11 22:54:06,223 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:06,223 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:06,223 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:06,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:06,223 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-03-11 22:54:06,224 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-03-11 22:54:06,224 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,41843,1678575183185' in zk 2023-03-11 22:54:06,224 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:06,224 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 22:54:06,224 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-03-11 22:54:06,224 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:06,224 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:54:06,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:06,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:54:06,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:54:06,224 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-03-11 22:54:06,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:54:06,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:54:06,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:06,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:06,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:54:06,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:06,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:06,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,41843,1678575183185': 2023-03-11 22:54:06,226 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-03-11 22:54:06,226 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-03-11 22:54:06,226 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 22:54:06,226 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 22:54:06,226 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:06,226 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 22:54:06,227 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:06,227 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:06,227 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:06,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:06,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:54:06,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:54:06,227 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:54:06,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:06,228 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:54:06,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:54:06,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:54:06,228 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:06,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:06,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:06,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:54:06,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:06,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:06,229 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:06,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:54:06,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:06,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:06,232 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:54:06,232 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:54:06,232 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:06,232 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:54:06,232 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:06,232 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:54:06,232 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:06,232 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-11 22:54:06,232 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 22:54:06,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:54:06,232 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:06,233 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:06,233 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:06,233 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:06,233 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-03-11 22:54:06,233 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 22:54:06,233 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:54:06,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:54:06,333 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 22:54:06,334 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 22:54:06,337 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-11 22:54:06,339 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-03-11 22:54:06,339 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:06,339 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-11 22:54:06,339 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:54:06,339 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-03-11 22:54:06,339 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-03-11 22:54:06,340 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:06,340 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:06,340 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:54:06,340 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:06,341 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:54:06,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:54:06,341 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:06,341 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 22:54:06,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:06,341 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:06,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 22:54:06,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:06,341 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:06,342 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-03-11 22:54:06,342 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:06,342 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-03-11 22:54:06,342 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:54:06,342 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-03-11 22:54:06,342 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 22:54:06,342 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 22:54:06,342 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678575242278.aa39ddf65a193cbb3b88f447adacec76. 2023-03-11 22:54:06,342 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678575242278.aa39ddf65a193cbb3b88f447adacec76. started... 2023-03-11 22:54:06,342 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing aa39ddf65a193cbb3b88f447adacec76 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-11 22:54:06,755 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201dfce6cd8d9c443899d5ffc87758d4864 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151201dfce6cd8d9c443899d5ffc87758d4864 2023-03-11 22:54:07,160 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76/.tmp/family1/5de039d1230543dfa95a5883c36d500e 2023-03-11 22:54:07,165 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76/.tmp/family1/5de039d1230543dfa95a5883c36d500e as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76/family1/5de039d1230543dfa95a5883c36d500e 2023-03-11 22:54:07,169 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76/family1/5de039d1230543dfa95a5883c36d500e, entries=1, sequenceid=13, filesize=5.0 K 2023-03-11 22:54:07,170 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for aa39ddf65a193cbb3b88f447adacec76 in 828ms, sequenceid=13, compaction requested=true 2023-03-11 22:54:07,170 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for aa39ddf65a193cbb3b88f447adacec76: 2023-03-11 22:54:07,170 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678575242278.aa39ddf65a193cbb3b88f447adacec76. 2023-03-11 22:54:07,170 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 22:54:07,170 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 22:54:07,170 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:07,170 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-03-11 22:54:07,170 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-03-11 22:54:07,172 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:07,172 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:07,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:07,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:54:07,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:54:07,172 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:07,172 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 22:54:07,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:54:07,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:54:07,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:07,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:07,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:54:07,173 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-03-11 22:54:07,173 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3b0e430e[Count = 0] remaining members to acquire global barrier 2023-03-11 22:54:07,173 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-03-11 22:54:07,173 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:07,174 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:07,174 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:07,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:07,174 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-03-11 22:54:07,174 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:07,174 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 22:54:07,174 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-03-11 22:54:07,175 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,41843,1678575183185' in zk 2023-03-11 22:54:07,175 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:07,175 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-03-11 22:54:07,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:07,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:54:07,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:54:07,176 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:54:07,176 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-03-11 22:54:07,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:54:07,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:54:07,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:07,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:07,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:54:07,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:07,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:07,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,41843,1678575183185': 2023-03-11 22:54:07,177 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-03-11 22:54:07,177 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-03-11 22:54:07,177 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 22:54:07,177 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 22:54:07,178 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:07,178 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 22:54:07,179 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:07,179 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:07,179 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:54:07,179 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:07,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:07,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:54:07,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:54:07,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:07,179 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:07,179 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:54:07,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:54:07,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:54:07,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:07,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:07,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:54:07,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:07,180 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:07,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:07,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:54:07,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:07,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:07,181 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:07,181 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:07,181 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:54:07,181 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:07,181 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:54:07,181 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:54:07,181 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:54:07,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:54:07,181 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-03-11 22:54:07,181 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-11 22:54:07,182 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 22:54:07,181 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:07,182 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:07,182 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:54:07,182 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:07,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:54:07,182 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-03-11 22:54:07,182 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:07,182 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 22:54:07,282 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 22:54:07,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 22:54:07,286 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-11 22:54:07,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-03-11 22:54:07,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:07,288 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-11 22:54:07,288 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:54:07,288 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-03-11 22:54:07,288 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-03-11 22:54:07,288 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:07,288 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:07,289 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:07,289 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:54:07,289 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:54:07,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:54:07,289 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:07,289 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 22:54:07,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:07,290 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:07,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 22:54:07,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:07,290 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:07,290 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-03-11 22:54:07,290 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:07,290 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-03-11 22:54:07,290 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:54:07,290 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-03-11 22:54:07,294 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 22:54:07,294 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678575242278.aa39ddf65a193cbb3b88f447adacec76. 2023-03-11 22:54:07,294 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 22:54:07,294 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678575242278.aa39ddf65a193cbb3b88f447adacec76. started... 2023-03-11 22:54:07,294 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing aa39ddf65a193cbb3b88f447adacec76 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-11 22:54:07,716 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120553dd9a870e2a4cd9b1cb389a44af9e8c to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015120553dd9a870e2a4cd9b1cb389a44af9e8c 2023-03-11 22:54:08,121 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76/.tmp/family1/cf043c89769943ae9ee3c85664770e5b 2023-03-11 22:54:08,125 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76/.tmp/family1/cf043c89769943ae9ee3c85664770e5b as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76/family1/cf043c89769943ae9ee3c85664770e5b 2023-03-11 22:54:08,130 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76/family1/cf043c89769943ae9ee3c85664770e5b, entries=1, sequenceid=17, filesize=5.0 K 2023-03-11 22:54:08,130 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for aa39ddf65a193cbb3b88f447adacec76 in 836ms, sequenceid=17, compaction requested=true 2023-03-11 22:54:08,130 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for aa39ddf65a193cbb3b88f447adacec76: 2023-03-11 22:54:08,130 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678575242278.aa39ddf65a193cbb3b88f447adacec76. 2023-03-11 22:54:08,131 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 22:54:08,131 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 22:54:08,131 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:08,131 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-03-11 22:54:08,131 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-03-11 22:54:08,132 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:08,132 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:08,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:08,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:54:08,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:54:08,132 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:08,132 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 22:54:08,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:54:08,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:54:08,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:08,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:08,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:54:08,133 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-03-11 22:54:08,133 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6f629f8e[Count = 0] remaining members to acquire global barrier 2023-03-11 22:54:08,133 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-03-11 22:54:08,133 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:08,134 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:08,134 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:08,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:08,134 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:08,134 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 22:54:08,134 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-03-11 22:54:08,134 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-03-11 22:54:08,134 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,41843,1678575183185' in zk 2023-03-11 22:54:08,135 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-03-11 22:54:08,135 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:08,135 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:54:08,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:08,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:54:08,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:54:08,135 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-03-11 22:54:08,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:54:08,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:54:08,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:08,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:08,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:54:08,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:08,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:08,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,41843,1678575183185': 2023-03-11 22:54:08,137 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-03-11 22:54:08,137 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-03-11 22:54:08,137 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 22:54:08,137 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 22:54:08,137 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:08,137 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 22:54:08,138 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:08,138 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:08,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:08,138 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:08,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:54:08,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:54:08,138 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:54:08,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:08,138 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:08,138 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:54:08,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:54:08,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:54:08,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:08,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:08,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:54:08,139 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:08,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:08,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:08,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:54:08,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:08,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:08,140 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:54:08,141 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:54:08,141 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:54:08,141 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:54:08,141 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:08,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:54:08,141 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-11 22:54:08,141 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 22:54:08,141 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-03-11 22:54:08,141 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:08,141 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:08,141 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:08,141 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:08,141 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:08,141 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-03-11 22:54:08,141 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:54:08,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:54:08,141 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:08,141 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 22:54:08,241 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 22:54:08,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 22:54:08,246 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-11 22:54:08,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-03-11 22:54:08,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:08,248 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-11 22:54:08,248 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:54:08,248 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-03-11 22:54:08,248 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-03-11 22:54:08,248 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:08,248 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:08,251 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:54:08,251 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:08,251 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:54:08,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:54:08,251 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:08,251 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 22:54:08,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:08,252 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:08,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 22:54:08,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:08,252 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:08,252 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-03-11 22:54:08,252 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:08,252 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-03-11 22:54:08,252 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:54:08,253 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-03-11 22:54:08,253 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 22:54:08,253 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 22:54:08,253 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678575242278.aa39ddf65a193cbb3b88f447adacec76. 2023-03-11 22:54:08,253 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678575242278.aa39ddf65a193cbb3b88f447adacec76. started... 2023-03-11 22:54:08,253 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing aa39ddf65a193cbb3b88f447adacec76 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-11 22:54:08,665 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512289d55b86839c245588cccaae256e9dcc7 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512289d55b86839c245588cccaae256e9dcc7 2023-03-11 22:54:08,950 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-11 22:54:09,071 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76/.tmp/family1/94d1edf17c24461da72a5f090866feb5 2023-03-11 22:54:09,080 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76/.tmp/family1/94d1edf17c24461da72a5f090866feb5 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76/family1/94d1edf17c24461da72a5f090866feb5 2023-03-11 22:54:09,087 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76/family1/94d1edf17c24461da72a5f090866feb5, entries=1, sequenceid=21, filesize=5.0 K 2023-03-11 22:54:09,088 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for aa39ddf65a193cbb3b88f447adacec76 in 835ms, sequenceid=21, compaction requested=true 2023-03-11 22:54:09,088 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for aa39ddf65a193cbb3b88f447adacec76: 2023-03-11 22:54:09,088 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678575242278.aa39ddf65a193cbb3b88f447adacec76. 2023-03-11 22:54:09,089 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 22:54:09,089 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 22:54:09,089 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:09,089 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-03-11 22:54:09,089 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-03-11 22:54:09,090 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:09,090 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:09,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:09,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:54:09,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:54:09,091 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:09,091 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 22:54:09,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:54:09,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:54:09,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:09,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:09,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:54:09,093 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-03-11 22:54:09,093 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1956c9c9[Count = 0] remaining members to acquire global barrier 2023-03-11 22:54:09,093 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-03-11 22:54:09,093 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:09,094 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:09,094 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:09,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:09,094 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-03-11 22:54:09,094 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-03-11 22:54:09,094 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,41843,1678575183185' in zk 2023-03-11 22:54:09,094 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:09,094 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 22:54:09,095 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:09,095 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-03-11 22:54:09,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:09,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:54:09,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:54:09,095 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:54:09,095 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-03-11 22:54:09,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:54:09,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:54:09,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:09,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:09,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:54:09,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:09,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:09,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,41843,1678575183185': 2023-03-11 22:54:09,098 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-03-11 22:54:09,098 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-03-11 22:54:09,098 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 22:54:09,099 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 22:54:09,099 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:09,099 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 22:54:09,100 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:09,100 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:09,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:09,100 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:09,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:54:09,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:54:09,100 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:54:09,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:09,100 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:09,100 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:54:09,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:54:09,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:54:09,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:09,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:09,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:54:09,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:09,101 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:09,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:09,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:54:09,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:09,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:09,103 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:09,103 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:09,103 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:09,103 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:54:09,103 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:54:09,103 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:09,103 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:54:09,103 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:09,103 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:09,103 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:09,103 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-11 22:54:09,103 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 22:54:09,103 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:54:09,103 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-03-11 22:54:09,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:54:09,103 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-03-11 22:54:09,104 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 22:54:09,104 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:54:09,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:54:09,204 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 22:54:09,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 22:54:09,209 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-11 22:54:09,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-03-11 22:54:09,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:09,210 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-11 22:54:09,210 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:54:09,210 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-03-11 22:54:09,211 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-03-11 22:54:09,211 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:09,211 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:09,212 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:09,212 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:54:09,212 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:54:09,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:54:09,212 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:09,212 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 22:54:09,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:09,213 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:09,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 22:54:09,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:09,213 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:09,214 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-03-11 22:54:09,214 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:09,214 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-03-11 22:54:09,214 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:54:09,214 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-03-11 22:54:09,214 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 22:54:09,214 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 22:54:09,214 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678575242278.aa39ddf65a193cbb3b88f447adacec76. 2023-03-11 22:54:09,214 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678575242278.aa39ddf65a193cbb3b88f447adacec76. started... 2023-03-11 22:54:09,214 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing aa39ddf65a193cbb3b88f447adacec76 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-11 22:54:09,631 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231ef7f8202644042e8882e93b322c5dfb2 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151231ef7f8202644042e8882e93b322c5dfb2 2023-03-11 22:54:10,038 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76/.tmp/family1/3ebd16bc71d641f68ea143c22f6b9cbb 2023-03-11 22:54:10,053 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76/.tmp/family1/3ebd16bc71d641f68ea143c22f6b9cbb as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76/family1/3ebd16bc71d641f68ea143c22f6b9cbb 2023-03-11 22:54:10,057 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76/family1/3ebd16bc71d641f68ea143c22f6b9cbb, entries=1, sequenceid=25, filesize=5.0 K 2023-03-11 22:54:10,058 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for aa39ddf65a193cbb3b88f447adacec76 in 844ms, sequenceid=25, compaction requested=true 2023-03-11 22:54:10,058 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for aa39ddf65a193cbb3b88f447adacec76: 2023-03-11 22:54:10,058 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678575242278.aa39ddf65a193cbb3b88f447adacec76. 2023-03-11 22:54:10,058 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 22:54:10,058 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 22:54:10,058 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:10,058 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-03-11 22:54:10,058 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-03-11 22:54:10,060 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:10,060 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:10,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:10,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:54:10,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:54:10,060 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:10,060 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 22:54:10,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:54:10,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:54:10,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:10,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:10,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:54:10,061 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-03-11 22:54:10,061 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@18e8557a[Count = 0] remaining members to acquire global barrier 2023-03-11 22:54:10,061 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-03-11 22:54:10,061 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:10,062 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:10,062 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:10,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:10,062 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-03-11 22:54:10,062 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-03-11 22:54:10,062 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,41843,1678575183185' in zk 2023-03-11 22:54:10,062 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:10,062 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 22:54:10,063 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-03-11 22:54:10,063 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:10,063 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:54:10,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:10,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:54:10,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:54:10,063 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-03-11 22:54:10,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:54:10,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:54:10,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:10,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:10,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:54:10,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:10,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:10,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,41843,1678575183185': 2023-03-11 22:54:10,065 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-03-11 22:54:10,065 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-03-11 22:54:10,065 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 22:54:10,065 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 22:54:10,065 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:10,065 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 22:54:10,066 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:10,066 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:10,066 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:10,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:10,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:54:10,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:54:10,066 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:54:10,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:10,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:54:10,066 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:54:10,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:54:10,066 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:10,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:10,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:10,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:54:10,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:10,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:10,067 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:10,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:54:10,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:10,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:10,068 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:10,068 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:10,068 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:10,068 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:54:10,068 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-11 22:54:10,068 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 22:54:10,068 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:54:10,068 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:54:10,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:54:10,068 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:54:10,068 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:10,069 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-03-11 22:54:10,069 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:54:10,069 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:10,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:54:10,069 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 22:54:10,069 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:10,069 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:10,169 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 22:54:10,170 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 22:54:10,178 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-11 22:54:10,181 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-03-11 22:54:10,181 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:10,181 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-11 22:54:10,181 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:54:10,181 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-03-11 22:54:10,181 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-03-11 22:54:10,182 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:10,182 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:10,184 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:10,184 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:54:10,184 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:54:10,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:54:10,184 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:10,184 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 22:54:10,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:10,185 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:10,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 22:54:10,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:10,186 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:10,186 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-03-11 22:54:10,186 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:10,186 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-03-11 22:54:10,186 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:54:10,186 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-03-11 22:54:10,186 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 22:54:10,187 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 22:54:10,187 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678575242278.aa39ddf65a193cbb3b88f447adacec76. 2023-03-11 22:54:10,187 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678575242278.aa39ddf65a193cbb3b88f447adacec76. started... 2023-03-11 22:54:10,187 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing aa39ddf65a193cbb3b88f447adacec76 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-11 22:54:10,605 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101c44e1ffe8ddd40dab92149c913e9d070 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160101c44e1ffe8ddd40dab92149c913e9d070 2023-03-11 22:54:11,014 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76/.tmp/family1/24375926a55141c7b7f312c48a72e156 2023-03-11 22:54:11,027 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76/.tmp/family1/24375926a55141c7b7f312c48a72e156 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76/family1/24375926a55141c7b7f312c48a72e156 2023-03-11 22:54:11,034 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76/family1/24375926a55141c7b7f312c48a72e156, entries=1, sequenceid=29, filesize=5.0 K 2023-03-11 22:54:11,035 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for aa39ddf65a193cbb3b88f447adacec76 in 848ms, sequenceid=29, compaction requested=true 2023-03-11 22:54:11,035 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for aa39ddf65a193cbb3b88f447adacec76: 2023-03-11 22:54:11,035 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678575242278.aa39ddf65a193cbb3b88f447adacec76. 2023-03-11 22:54:11,035 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 22:54:11,035 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 22:54:11,035 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:11,035 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-03-11 22:54:11,036 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-03-11 22:54:11,037 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:11,037 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:11,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:11,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:54:11,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:54:11,038 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:11,038 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 22:54:11,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:54:11,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:54:11,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:11,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:11,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:54:11,039 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-03-11 22:54:11,039 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-03-11 22:54:11,039 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@51b7735a[Count = 0] remaining members to acquire global barrier 2023-03-11 22:54:11,039 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:11,040 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:11,040 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:11,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:11,040 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-03-11 22:54:11,040 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:11,040 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 22:54:11,040 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-03-11 22:54:11,040 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,41843,1678575183185' in zk 2023-03-11 22:54:11,042 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:11,042 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-03-11 22:54:11,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:11,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:54:11,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:54:11,042 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:54:11,042 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-03-11 22:54:11,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:54:11,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:54:11,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:11,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:11,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:54:11,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:11,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:11,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,41843,1678575183185': 2023-03-11 22:54:11,044 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-03-11 22:54:11,044 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-03-11 22:54:11,044 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 22:54:11,044 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 22:54:11,044 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:11,044 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 22:54:11,045 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:11,045 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:11,045 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:11,045 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:54:11,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:11,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:11,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:54:11,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:54:11,045 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:54:11,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:54:11,045 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:11,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:54:11,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:11,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:11,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:54:11,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:11,046 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:11,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:11,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:54:11,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:11,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:11,047 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:11,047 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:54:11,047 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:11,047 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:11,047 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:11,047 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-11 22:54:11,047 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 22:54:11,047 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:54:11,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:54:11,047 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:11,047 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:54:11,047 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:54:11,047 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:11,048 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-03-11 22:54:11,048 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:54:11,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:54:11,048 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:11,048 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 22:54:11,148 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 22:54:11,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 22:54:11,155 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-11 22:54:11,158 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-03-11 22:54:11,158 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:11,158 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-11 22:54:11,158 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:54:11,158 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-03-11 22:54:11,158 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-03-11 22:54:11,159 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:11,159 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:11,161 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:54:11,161 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:11,161 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:54:11,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:54:11,161 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:11,162 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 22:54:11,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:11,163 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:11,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 22:54:11,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:11,164 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:11,164 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-03-11 22:54:11,165 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:11,165 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-03-11 22:54:11,165 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:54:11,165 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-03-11 22:54:11,165 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 22:54:11,165 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 22:54:11,165 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678575242278.aa39ddf65a193cbb3b88f447adacec76. 2023-03-11 22:54:11,165 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678575242278.aa39ddf65a193cbb3b88f447adacec76. started... 2023-03-11 22:54:11,165 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing aa39ddf65a193cbb3b88f447adacec76 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-11 22:54:11,586 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103d79cd2f27e5c457d97a0be515ba65ad9 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160103d79cd2f27e5c457d97a0be515ba65ad9 2023-03-11 22:54:11,993 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76/.tmp/family1/12117d2c801e4559874fea78777ad1c6 2023-03-11 22:54:12,005 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76/.tmp/family1/12117d2c801e4559874fea78777ad1c6 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76/family1/12117d2c801e4559874fea78777ad1c6 2023-03-11 22:54:12,009 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76/family1/12117d2c801e4559874fea78777ad1c6, entries=1, sequenceid=33, filesize=5.0 K 2023-03-11 22:54:12,010 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for aa39ddf65a193cbb3b88f447adacec76 in 845ms, sequenceid=33, compaction requested=true 2023-03-11 22:54:12,010 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for aa39ddf65a193cbb3b88f447adacec76: 2023-03-11 22:54:12,010 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678575242278.aa39ddf65a193cbb3b88f447adacec76. 2023-03-11 22:54:12,010 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 22:54:12,010 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 22:54:12,010 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:12,010 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-03-11 22:54:12,010 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-03-11 22:54:12,011 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:12,012 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:12,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:12,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:54:12,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:54:12,012 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:12,012 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 22:54:12,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:54:12,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:54:12,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:12,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:12,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:54:12,013 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-03-11 22:54:12,013 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-03-11 22:54:12,013 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2a52080d[Count = 0] remaining members to acquire global barrier 2023-03-11 22:54:12,013 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:12,014 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:12,014 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:12,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:12,014 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-03-11 22:54:12,014 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-03-11 22:54:12,014 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,41843,1678575183185' in zk 2023-03-11 22:54:12,014 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:12,014 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 22:54:12,015 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:12,015 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-03-11 22:54:12,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:12,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:54:12,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:54:12,015 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:54:12,015 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-03-11 22:54:12,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:54:12,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:54:12,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:12,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:12,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:54:12,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:12,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:12,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,41843,1678575183185': 2023-03-11 22:54:12,018 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-03-11 22:54:12,018 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-03-11 22:54:12,018 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 22:54:12,018 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 22:54:12,018 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:12,018 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 22:54:12,019 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:12,019 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:12,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:12,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:54:12,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:54:12,019 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:12,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:12,019 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:54:12,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:54:12,020 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:54:12,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:54:12,020 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:12,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:12,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:12,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:54:12,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:12,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:12,021 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:12,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:54:12,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:12,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:12,023 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:12,023 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:54:12,023 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:12,023 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:54:12,023 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-11 22:54:12,023 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-03-11 22:54:12,023 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:12,023 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:54:12,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:54:12,023 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:54:12,023 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:12,023 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 22:54:12,023 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:12,023 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:12,023 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:12,024 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:54:12,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:54:12,024 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-03-11 22:54:12,024 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 22:54:12,124 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 22:54:12,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 22:54:12,136 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-11 22:54:12,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-03-11 22:54:12,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:12,140 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-11 22:54:12,140 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:54:12,140 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-03-11 22:54:12,140 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-03-11 22:54:12,141 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:12,141 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:12,142 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:12,142 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:54:12,142 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:54:12,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:54:12,142 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:12,142 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 22:54:12,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:12,142 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:12,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 22:54:12,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:12,143 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:12,143 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-03-11 22:54:12,143 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:12,143 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-03-11 22:54:12,143 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:54:12,143 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-03-11 22:54:12,143 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 22:54:12,143 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 22:54:12,143 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678575242278.aa39ddf65a193cbb3b88f447adacec76. 2023-03-11 22:54:12,143 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678575242278.aa39ddf65a193cbb3b88f447adacec76. started... 2023-03-11 22:54:12,143 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing aa39ddf65a193cbb3b88f447adacec76 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-11 22:54:12,562 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907a139d82f96cc46fa998c2179ec37e823 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20150907a139d82f96cc46fa998c2179ec37e823 2023-03-11 22:54:12,969 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76/.tmp/family1/41781fdf7cba4934bec48b4ab1c9892a 2023-03-11 22:54:12,974 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76/.tmp/family1/41781fdf7cba4934bec48b4ab1c9892a as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76/family1/41781fdf7cba4934bec48b4ab1c9892a 2023-03-11 22:54:12,978 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76/family1/41781fdf7cba4934bec48b4ab1c9892a, entries=1, sequenceid=37, filesize=5.0 K 2023-03-11 22:54:12,979 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for aa39ddf65a193cbb3b88f447adacec76 in 836ms, sequenceid=37, compaction requested=true 2023-03-11 22:54:12,979 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for aa39ddf65a193cbb3b88f447adacec76: 2023-03-11 22:54:12,979 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678575242278.aa39ddf65a193cbb3b88f447adacec76. 2023-03-11 22:54:12,979 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 22:54:12,979 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 22:54:12,979 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:12,979 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-03-11 22:54:12,979 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-03-11 22:54:12,980 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:12,980 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:12,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:12,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:54:12,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:54:12,980 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:12,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:54:12,980 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 22:54:12,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:54:12,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:12,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:12,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:54:12,981 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-03-11 22:54:12,981 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@565940f[Count = 0] remaining members to acquire global barrier 2023-03-11 22:54:12,981 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-03-11 22:54:12,981 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:12,982 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:12,982 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:12,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:12,982 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-03-11 22:54:12,982 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-03-11 22:54:12,982 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,41843,1678575183185' in zk 2023-03-11 22:54:12,982 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:12,982 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 22:54:12,983 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-03-11 22:54:12,983 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:54:12,983 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:12,983 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-03-11 22:54:12,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:12,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:54:12,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:54:12,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:54:12,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:54:12,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:12,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:12,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:54:12,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:12,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:12,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,41843,1678575183185': 2023-03-11 22:54:12,985 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-03-11 22:54:12,985 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-03-11 22:54:12,985 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 22:54:12,985 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 22:54:12,985 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:12,985 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 22:54:12,986 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:12,986 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:12,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:12,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:54:12,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:54:12,986 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:54:12,986 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:12,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:12,986 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:54:12,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:54:12,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:12,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:54:12,987 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:12,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:12,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:54:12,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:12,989 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:12,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:12,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:54:12,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:12,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:12,991 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:12,991 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:12,991 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:12,991 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:12,991 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:54:12,991 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-03-11 22:54:12,991 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-11 22:54:12,991 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 22:54:12,991 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:12,991 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:54:12,991 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:12,991 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:54:12,991 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:54:12,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:54:12,991 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:12,991 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-03-11 22:54:12,992 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 22:54:12,992 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:54:12,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:54:13,092 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 22:54:13,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 22:54:13,096 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-11 22:54:13,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-03-11 22:54:13,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:13,097 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-11 22:54:13,098 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:54:13,098 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-03-11 22:54:13,098 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-03-11 22:54:13,098 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:13,098 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:13,099 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:13,099 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:54:13,099 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:54:13,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:54:13,099 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:13,099 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 22:54:13,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:13,099 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:13,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 22:54:13,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:13,100 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:13,100 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-03-11 22:54:13,100 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:13,100 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-03-11 22:54:13,100 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:54:13,100 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-03-11 22:54:13,102 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 22:54:13,102 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 22:54:13,102 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678575242278.aa39ddf65a193cbb3b88f447adacec76. 2023-03-11 22:54:13,102 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678575242278.aa39ddf65a193cbb3b88f447adacec76. started... 2023-03-11 22:54:13,102 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing aa39ddf65a193cbb3b88f447adacec76 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-11 22:54:13,513 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120256a6e89b71e409aa71c4422872a911e to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151120256a6e89b71e409aa71c4422872a911e 2023-03-11 22:54:13,919 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76/.tmp/family1/66d9a0bfdb1047cb9b970bad87ebe459 2023-03-11 22:54:13,923 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76/.tmp/family1/66d9a0bfdb1047cb9b970bad87ebe459 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76/family1/66d9a0bfdb1047cb9b970bad87ebe459 2023-03-11 22:54:13,926 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76/family1/66d9a0bfdb1047cb9b970bad87ebe459, entries=1, sequenceid=41, filesize=5.0 K 2023-03-11 22:54:13,927 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for aa39ddf65a193cbb3b88f447adacec76 in 825ms, sequenceid=41, compaction requested=true 2023-03-11 22:54:13,927 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for aa39ddf65a193cbb3b88f447adacec76: 2023-03-11 22:54:13,927 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678575242278.aa39ddf65a193cbb3b88f447adacec76. 2023-03-11 22:54:13,927 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 22:54:13,927 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 22:54:13,927 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:13,927 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-03-11 22:54:13,927 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-03-11 22:54:13,928 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:13,928 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:13,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:13,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:54:13,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:54:13,928 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:13,928 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 22:54:13,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:54:13,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:54:13,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:13,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:13,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:54:13,930 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-03-11 22:54:13,930 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-03-11 22:54:13,930 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5f7c525c[Count = 0] remaining members to acquire global barrier 2023-03-11 22:54:13,930 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:13,930 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:13,930 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:13,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:13,930 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-03-11 22:54:13,931 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-03-11 22:54:13,931 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,41843,1678575183185' in zk 2023-03-11 22:54:13,931 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:13,931 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 22:54:13,931 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:13,931 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-03-11 22:54:13,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:13,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:54:13,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:54:13,931 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:54:13,932 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-03-11 22:54:13,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:54:13,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:54:13,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:13,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:13,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:54:13,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:13,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:13,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,41843,1678575183185': 2023-03-11 22:54:13,934 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-03-11 22:54:13,934 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-03-11 22:54:13,934 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 22:54:13,934 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 22:54:13,934 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:13,934 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 22:54:13,945 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:13,945 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:54:13,945 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:13,945 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:13,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:13,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:13,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:54:13,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:54:13,945 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:54:13,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:54:13,945 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:13,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:54:13,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:13,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:13,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:54:13,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:13,946 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:13,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:13,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:54:13,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:13,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:13,948 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:13,948 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:54:13,948 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:13,948 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:54:13,948 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:54:13,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:54:13,948 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:54:13,948 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:13,948 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-03-11 22:54:13,948 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-11 22:54:13,948 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 22:54:13,948 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:13,948 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:13,948 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:13,948 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:13,948 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:54:13,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:54:13,948 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-03-11 22:54:13,948 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 22:54:14,049 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 22:54:14,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 22:54:14,051 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=44347] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:14,052 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-03-11 22:54:14,053 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=42, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-03-11 22:54:14,053 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-11 22:54:14,053 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=42, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1678575854053 2023-03-11 22:54:14,056 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-11 22:54:14,057 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-03-11 22:54:14,057 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-11 22:54:14,057 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] zookeeper.ReadOnlyZKClient(139): Connect 0x5c72f008 to 127.0.0.1:51815 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-11 22:54:14,061 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@754e5b3e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-11 22:54:14,061 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-11 22:54:14,904 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103a91bd3f3170b40f2bd0846f548a9c6c1 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160103a91bd3f3170b40f2bd0846f548a9c6c1 2023-03-11 22:54:14,905 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-11 22:54:14,917 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-11 22:54:14,922 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:41954, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-11 22:54:14,930 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-11 22:54:14,934 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:44314, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-11 22:54:14,954 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/2ffbbde29be8402d9b9939ff4cd9cb4b first=Optional[r3] last=Optional[r6] 2023-03-11 22:54:14,955 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678575242278.aa39ddf65a193cbb3b88f447adacec76., hostname=jenkins-hbase20.apache.org,41843,1678575183185, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/2ffbbde29be8402d9b9939ff4cd9cb4b}] 2023-03-11 22:54:14,959 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/2ffbbde29be8402d9b9939ff4cd9cb4b for inclusion in aa39ddf65a193cbb3b88f447adacec76/family1 2023-03-11 22:54:14,961 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-03-11 22:54:14,961 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(777): Region bounds: first= last= 2023-03-11 22:54:14,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HRegion(2446): Flush status journal for aa39ddf65a193cbb3b88f447adacec76: 2023-03-11 22:54:14,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/2ffbbde29be8402d9b9939ff4cd9cb4b to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__i9ilsof5f5d4dptabi6m26aoivne83d7011k7sm4m1lqpm35j6255e7d5ssao8pc/family1/2ffbbde29be8402d9b9939ff4cd9cb4b 2023-03-11 22:54:14,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__i9ilsof5f5d4dptabi6m26aoivne83d7011k7sm4m1lqpm35j6255e7d5ssao8pc/family1/2ffbbde29be8402d9b9939ff4cd9cb4b as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76/family1/cc2d6b90e09b4acc8e54c106c489089c_SeqId_44_ 2023-03-11 22:54:14,966 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__i9ilsof5f5d4dptabi6m26aoivne83d7011k7sm4m1lqpm35j6255e7d5ssao8pc/family1/2ffbbde29be8402d9b9939ff4cd9cb4b into aa39ddf65a193cbb3b88f447adacec76/family1 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76/family1/cc2d6b90e09b4acc8e54c106c489089c_SeqId_44_ - updating store file list. 2023-03-11 22:54:14,969 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76/family1/cc2d6b90e09b4acc8e54c106c489089c_SeqId_44_ into aa39ddf65a193cbb3b88f447adacec76/family1 2023-03-11 22:54:14,969 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__i9ilsof5f5d4dptabi6m26aoivne83d7011k7sm4m1lqpm35j6255e7d5ssao8pc/family1/2ffbbde29be8402d9b9939ff4cd9cb4b into aa39ddf65a193cbb3b88f447adacec76/family1 (new location: hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76/family1/cc2d6b90e09b4acc8e54c106c489089c_SeqId_44_) 2023-03-11 22:54:14,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__i9ilsof5f5d4dptabi6m26aoivne83d7011k7sm4m1lqpm35j6255e7d5ssao8pc/family1/2ffbbde29be8402d9b9939ff4cd9cb4b 2023-03-11 22:54:14,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-03-11 22:54:14,973 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51565 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-03-11 22:54:14,973 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(1912): aa39ddf65a193cbb3b88f447adacec76/family1 is initiating minor compaction 2023-03-11 22:54:14,973 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@24b95c27; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-11 22:54:14,973 INFO [RS:0;jenkins-hbase20:41843-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of aa39ddf65a193cbb3b88f447adacec76/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678575242278.aa39ddf65a193cbb3b88f447adacec76. 2023-03-11 22:54:14,973 INFO [RS:0;jenkins-hbase20:41843-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76/family1/3a040208e66f4d9ba9c0b80de86a38c3, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76/family1/5de039d1230543dfa95a5883c36d500e, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76/family1/cf043c89769943ae9ee3c85664770e5b, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76/family1/94d1edf17c24461da72a5f090866feb5, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76/family1/3ebd16bc71d641f68ea143c22f6b9cbb, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76/family1/24375926a55141c7b7f312c48a72e156, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76/family1/12117d2c801e4559874fea78777ad1c6, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76/family1/41781fdf7cba4934bec48b4ab1c9892a, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76/family1/66d9a0bfdb1047cb9b970bad87ebe459, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76/family1/cc2d6b90e09b4acc8e54c106c489089c_SeqId_44_] into tmpdir=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76/.tmp, totalSize=50.4 K 2023-03-11 22:54:14,973 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] compactions.Compactor(207): Compacting 3a040208e66f4d9ba9c0b80de86a38c3, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-03-11 22:54:14,973 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] compactions.Compactor(207): Compacting 5de039d1230543dfa95a5883c36d500e, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-03-11 22:54:14,973 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] compactions.Compactor(207): Compacting cf043c89769943ae9ee3c85664770e5b, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-03-11 22:54:14,973 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] compactions.Compactor(207): Compacting 94d1edf17c24461da72a5f090866feb5, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-03-11 22:54:14,973 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] compactions.Compactor(207): Compacting 3ebd16bc71d641f68ea143c22f6b9cbb, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-03-11 22:54:14,973 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] compactions.Compactor(207): Compacting 24375926a55141c7b7f312c48a72e156, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-03-11 22:54:14,973 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] compactions.Compactor(207): Compacting 12117d2c801e4559874fea78777ad1c6, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-03-11 22:54:14,973 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] compactions.Compactor(207): Compacting 41781fdf7cba4934bec48b4ab1c9892a, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-03-11 22:54:14,974 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] compactions.Compactor(207): Compacting 66d9a0bfdb1047cb9b970bad87ebe459, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-03-11 22:54:14,974 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] compactions.Compactor(207): Compacting cc2d6b90e09b4acc8e54c106c489089c_SeqId_44_, keycount=4, bloomtype=ROW, size=5.6 K, encoding=NONE, compression=NONE, seqNum=45 2023-03-11 22:54:14,975 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-11 22:54:14,975 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 22:54:14,979 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512289d55b86839c245588cccaae256e9dcc7 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512289d55b86839c245588cccaae256e9dcc7 2023-03-11 22:54:14,979 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151231ef7f8202644042e8882e93b322c5dfb2 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151231ef7f8202644042e8882e93b322c5dfb2 2023-03-11 22:54:14,980 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160101c44e1ffe8ddd40dab92149c913e9d070 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160101c44e1ffe8ddd40dab92149c913e9d070 2023-03-11 22:54:14,981 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160103d79cd2f27e5c457d97a0be515ba65ad9 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160103d79cd2f27e5c457d97a0be515ba65ad9 2023-03-11 22:54:14,981 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 4 expired mob files are deleted 2023-03-11 22:54:14,981 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-03-11 22:54:14,982 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-11 22:54:14,982 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-11 22:54:14,982 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-11 22:54:14,982 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-11 22:54:14,982 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-11 22:54:14,982 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-11 22:54:14,982 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-11 22:54:14,982 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-11 22:54:15,018 INFO [RS:0;jenkins-hbase20:41843-shortCompactions-0] throttle.PressureAwareThroughputController(145): aa39ddf65a193cbb3b88f447adacec76#family1#compaction#61 average throughput is 0.20 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-11 22:54:15,478 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76/.tmp/family1/505eef81e6014dd5987772c5ff882276 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76/family1/505eef81e6014dd5987772c5ff882276 2023-03-11 22:54:15,483 INFO [RS:0;jenkins-hbase20:41843-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in aa39ddf65a193cbb3b88f447adacec76/family1 of aa39ddf65a193cbb3b88f447adacec76 into 505eef81e6014dd5987772c5ff882276(size=6.8 K), total size for store is 198.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-11 22:54:15,483 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for aa39ddf65a193cbb3b88f447adacec76: 2023-03-11 22:54:15,483 INFO [RS:0;jenkins-hbase20:41843-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678575242278.aa39ddf65a193cbb3b88f447adacec76., storeName=family1, fileCount=10, fileSize=50.4 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.6 K), priority=2, time=1678575254973; duration=0sec 2023-03-11 22:54:15,483 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-11 22:54:15,496 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205cb7948e1a9ff4b2696f9c95395089980 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205cb7948e1a9ff4b2696f9c95395089980 2023-03-11 22:54:15,497 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-11 22:54:15,522 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/6e4ccd626dfa4642927c2693c4e957f5 first=Optional[r00] last=Optional[r2] 2023-03-11 22:54:15,523 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678575242278.aa39ddf65a193cbb3b88f447adacec76., hostname=jenkins-hbase20.apache.org,41843,1678575183185, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/6e4ccd626dfa4642927c2693c4e957f5}] 2023-03-11 22:54:15,524 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/6e4ccd626dfa4642927c2693c4e957f5 for inclusion in aa39ddf65a193cbb3b88f447adacec76/family1 2023-03-11 22:54:15,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-03-11 22:54:15,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(777): Region bounds: first= last= 2023-03-11 22:54:15,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HRegion(2446): Flush status journal for aa39ddf65a193cbb3b88f447adacec76: 2023-03-11 22:54:15,528 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/6e4ccd626dfa4642927c2693c4e957f5 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__o2tqqcdug8f594s9l0s823c78o1fv1h7rn2jl1lagaa00jtcaoerjs4nj72p7rtk/family1/6e4ccd626dfa4642927c2693c4e957f5 2023-03-11 22:54:15,530 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__o2tqqcdug8f594s9l0s823c78o1fv1h7rn2jl1lagaa00jtcaoerjs4nj72p7rtk/family1/6e4ccd626dfa4642927c2693c4e957f5 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76/family1/8a63554207c0442da6fd46c2b1e5305f_SeqId_47_ 2023-03-11 22:54:15,531 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__o2tqqcdug8f594s9l0s823c78o1fv1h7rn2jl1lagaa00jtcaoerjs4nj72p7rtk/family1/6e4ccd626dfa4642927c2693c4e957f5 into aa39ddf65a193cbb3b88f447adacec76/family1 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76/family1/8a63554207c0442da6fd46c2b1e5305f_SeqId_47_ - updating store file list. 2023-03-11 22:54:15,534 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76/family1/8a63554207c0442da6fd46c2b1e5305f_SeqId_47_ into aa39ddf65a193cbb3b88f447adacec76/family1 2023-03-11 22:54:15,534 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__o2tqqcdug8f594s9l0s823c78o1fv1h7rn2jl1lagaa00jtcaoerjs4nj72p7rtk/family1/6e4ccd626dfa4642927c2693c4e957f5 into aa39ddf65a193cbb3b88f447adacec76/family1 (new location: hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76/family1/8a63554207c0442da6fd46c2b1e5305f_SeqId_47_) 2023-03-11 22:54:15,534 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__o2tqqcdug8f594s9l0s823c78o1fv1h7rn2jl1lagaa00jtcaoerjs4nj72p7rtk/family1/6e4ccd626dfa4642927c2693c4e957f5 2023-03-11 22:54:15,534 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-03-11 22:54:15,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 399433 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-03-11 22:54:15,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(1912): aa39ddf65a193cbb3b88f447adacec76/family1 is initiating minor compaction (all files) 2023-03-11 22:54:15,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@6fa61248; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-03-11 22:54:15,536 INFO [RS:0;jenkins-hbase20:41843-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of aa39ddf65a193cbb3b88f447adacec76/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678575242278.aa39ddf65a193cbb3b88f447adacec76. 2023-03-11 22:54:15,536 INFO [RS:0;jenkins-hbase20:41843-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76/family1/c51dc9e6cf6d4ed480c2fcec3c9ed9db, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76/family1/505eef81e6014dd5987772c5ff882276, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76/family1/8a63554207c0442da6fd46c2b1e5305f_SeqId_47_] into tmpdir=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76/.tmp, totalSize=390.1 K 2023-03-11 22:54:15,536 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] compactions.Compactor(207): Compacting c51dc9e6cf6d4ed480c2fcec3c9ed9db, keycount=1000, bloomtype=ROW, size=191.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878807597 2023-03-11 22:54:15,536 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] compactions.Compactor(207): Compacting 505eef81e6014dd5987772c5ff882276, keycount=9, bloomtype=ROW, size=6.8 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621207597 2023-03-11 22:54:15,537 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] compactions.Compactor(207): Compacting 8a63554207c0442da6fd46c2b1e5305f_SeqId_47_, keycount=1002, bloomtype=ROW, size=191.8 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878807597 2023-03-11 22:54:15,537 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-11 22:54:15,538 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 22:54:15,539 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015113043df3f40e19e415ca2db7b174ae58cb3 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015113043df3f40e19e415ca2db7b174ae58cb3 2023-03-11 22:54:15,540 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151201dfce6cd8d9c443899d5ffc87758d4864 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151201dfce6cd8d9c443899d5ffc87758d4864 2023-03-11 22:54:15,541 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015120553dd9a870e2a4cd9b1cb389a44af9e8c to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015120553dd9a870e2a4cd9b1cb389a44af9e8c 2023-03-11 22:54:15,541 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 3 expired mob files are deleted 2023-03-11 22:54:15,541 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-03-11 22:54:15,541 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-11 22:54:15,541 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-11 22:54:15,541 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-11 22:54:15,542 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=42, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-03-11 22:54:15,543 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 1.4910 sec 2023-03-11 22:54:15,556 INFO [RS:0;jenkins-hbase20:41843-shortCompactions-0] throttle.PressureAwareThroughputController(145): aa39ddf65a193cbb3b88f447adacec76#family1#compaction#62 average throughput is 15.05 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-11 22:54:15,575 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76/family1/3a040208e66f4d9ba9c0b80de86a38c3, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76/family1/5de039d1230543dfa95a5883c36d500e, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76/family1/cf043c89769943ae9ee3c85664770e5b, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76/family1/94d1edf17c24461da72a5f090866feb5, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76/family1/3ebd16bc71d641f68ea143c22f6b9cbb, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76/family1/24375926a55141c7b7f312c48a72e156, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76/family1/12117d2c801e4559874fea78777ad1c6, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76/family1/41781fdf7cba4934bec48b4ab1c9892a, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76/family1/66d9a0bfdb1047cb9b970bad87ebe459, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76/family1/cc2d6b90e09b4acc8e54c106c489089c_SeqId_44_] to archive 2023-03-11 22:54:15,576 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 22:54:15,577 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76/family1/3a040208e66f4d9ba9c0b80de86a38c3 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76/family1/3a040208e66f4d9ba9c0b80de86a38c3 2023-03-11 22:54:15,579 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76/family1/5de039d1230543dfa95a5883c36d500e to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76/family1/5de039d1230543dfa95a5883c36d500e 2023-03-11 22:54:15,580 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76/family1/cf043c89769943ae9ee3c85664770e5b to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76/family1/cf043c89769943ae9ee3c85664770e5b 2023-03-11 22:54:15,582 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76/family1/94d1edf17c24461da72a5f090866feb5 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76/family1/94d1edf17c24461da72a5f090866feb5 2023-03-11 22:54:15,584 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76/family1/3ebd16bc71d641f68ea143c22f6b9cbb to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76/family1/3ebd16bc71d641f68ea143c22f6b9cbb 2023-03-11 22:54:15,585 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76/family1/24375926a55141c7b7f312c48a72e156 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76/family1/24375926a55141c7b7f312c48a72e156 2023-03-11 22:54:15,586 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76/family1/12117d2c801e4559874fea78777ad1c6 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76/family1/12117d2c801e4559874fea78777ad1c6 2023-03-11 22:54:15,588 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76/family1/41781fdf7cba4934bec48b4ab1c9892a to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76/family1/41781fdf7cba4934bec48b4ab1c9892a 2023-03-11 22:54:15,589 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76/family1/66d9a0bfdb1047cb9b970bad87ebe459 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76/family1/66d9a0bfdb1047cb9b970bad87ebe459 2023-03-11 22:54:15,591 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76/family1/cc2d6b90e09b4acc8e54c106c489089c_SeqId_44_ to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76/family1/cc2d6b90e09b4acc8e54c106c489089c_SeqId_44_ 2023-03-11 22:54:15,616 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.HMaster$12(2454): Client=jenkins//148.251.75.209 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-03-11 22:54:15,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure2.ProcedureExecutor(1029): Stored pid=43, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:16,026 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-03-11 22:54:16,027 DEBUG [PEWorker-2] util.FSTableDescriptors(519): Deleted hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000001 2023-03-11 22:54:16,027 INFO [PEWorker-2] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-03-11 22:54:16,029 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=43, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly}] 2023-03-11 22:54:16,031 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=aa39ddf65a193cbb3b88f447adacec76, REOPEN/MOVE}] 2023-03-11 22:54:16,032 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=aa39ddf65a193cbb3b88f447adacec76, REOPEN/MOVE 2023-03-11 22:54:16,032 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=aa39ddf65a193cbb3b88f447adacec76, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:16,033 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678575242278.aa39ddf65a193cbb3b88f447adacec76.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1678575256032"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1678575256032"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678575256032"}]},"ts":"1678575256032"} 2023-03-11 22:54:16,034 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=45, state=RUNNABLE; CloseRegionProcedure aa39ddf65a193cbb3b88f447adacec76, server=jenkins-hbase20.apache.org,41843,1678575183185}] 2023-03-11 22:54:16,185 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close aa39ddf65a193cbb3b88f447adacec76 2023-03-11 22:54:16,186 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing aa39ddf65a193cbb3b88f447adacec76, disabling compactions & flushes 2023-03-11 22:54:16,186 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1858): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678575242278.aa39ddf65a193cbb3b88f447adacec76. 2023-03-11 22:54:16,774 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76/.tmp/family1/5a07b1ad785c4421b5067f044af325bc as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76/family1/5a07b1ad785c4421b5067f044af325bc 2023-03-11 22:54:16,779 INFO [RS:0;jenkins-hbase20:41843-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in aa39ddf65a193cbb3b88f447adacec76/family1 of aa39ddf65a193cbb3b88f447adacec76 into 5a07b1ad785c4421b5067f044af325bc(size=193.0 K), total size for store is 193.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-11 22:54:16,779 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for aa39ddf65a193cbb3b88f447adacec76: 2023-03-11 22:54:16,779 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678575242278.aa39ddf65a193cbb3b88f447adacec76. 2023-03-11 22:54:16,779 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678575242278.aa39ddf65a193cbb3b88f447adacec76. 2023-03-11 22:54:16,779 INFO [RS:0;jenkins-hbase20:41843-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678575242278.aa39ddf65a193cbb3b88f447adacec76., storeName=family1, fileCount=3, fileSize=390.1 K (191.4 K, 6.8 K, 191.8 K), priority=2, time=1678575255535; duration=1sec 2023-03-11 22:54:16,779 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678575242278.aa39ddf65a193cbb3b88f447adacec76. after waiting 0 ms 2023-03-11 22:54:16,779 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678575242278.aa39ddf65a193cbb3b88f447adacec76. 2023-03-11 22:54:16,779 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-11 22:54:16,780 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678575242278.aa39ddf65a193cbb3b88f447adacec76.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76/family1/c51dc9e6cf6d4ed480c2fcec3c9ed9db, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76/family1/505eef81e6014dd5987772c5ff882276, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76/family1/8a63554207c0442da6fd46c2b1e5305f_SeqId_47_] to archive 2023-03-11 22:54:16,780 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678575242278.aa39ddf65a193cbb3b88f447adacec76.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 22:54:16,782 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678575242278.aa39ddf65a193cbb3b88f447adacec76.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76/family1/c51dc9e6cf6d4ed480c2fcec3c9ed9db to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76/family1/c51dc9e6cf6d4ed480c2fcec3c9ed9db 2023-03-11 22:54:16,783 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678575242278.aa39ddf65a193cbb3b88f447adacec76.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76/family1/505eef81e6014dd5987772c5ff882276 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76/family1/505eef81e6014dd5987772c5ff882276 2023-03-11 22:54:16,784 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678575242278.aa39ddf65a193cbb3b88f447adacec76.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76/family1/8a63554207c0442da6fd46c2b1e5305f_SeqId_47_ to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76/family1/8a63554207c0442da6fd46c2b1e5305f_SeqId_47_ 2023-03-11 22:54:16,788 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-03-11 22:54:16,789 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678575242278.aa39ddf65a193cbb3b88f447adacec76. 2023-03-11 22:54:16,789 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for aa39ddf65a193cbb3b88f447adacec76: 2023-03-11 22:54:16,789 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(3509): Not adding moved region record: aa39ddf65a193cbb3b88f447adacec76 to self. 2023-03-11 22:54:16,791 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed aa39ddf65a193cbb3b88f447adacec76 2023-03-11 22:54:16,791 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=aa39ddf65a193cbb3b88f447adacec76, regionState=CLOSED 2023-03-11 22:54:16,791 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678575242278.aa39ddf65a193cbb3b88f447adacec76.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1678575256791"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678575256791"}]},"ts":"1678575256791"} 2023-03-11 22:54:16,793 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=45 2023-03-11 22:54:16,793 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=45, state=SUCCESS; CloseRegionProcedure aa39ddf65a193cbb3b88f447adacec76, server=jenkins-hbase20.apache.org,41843,1678575183185 in 758 msec 2023-03-11 22:54:16,793 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=aa39ddf65a193cbb3b88f447adacec76, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase20.apache.org,41843,1678575183185; forceNewPlan=false, retain=true 2023-03-11 22:54:16,943 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=aa39ddf65a193cbb3b88f447adacec76, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:16,944 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678575242278.aa39ddf65a193cbb3b88f447adacec76.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1678575256943"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1678575256943"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678575256943"}]},"ts":"1678575256943"} 2023-03-11 22:54:16,945 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=45, state=RUNNABLE; OpenRegionProcedure aa39ddf65a193cbb3b88f447adacec76, server=jenkins-hbase20.apache.org,41843,1678575183185}] 2023-03-11 22:54:17,100 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678575242278.aa39ddf65a193cbb3b88f447adacec76. 2023-03-11 22:54:17,100 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => aa39ddf65a193cbb3b88f447adacec76, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678575242278.aa39ddf65a193cbb3b88f447adacec76.', STARTKEY => '', ENDKEY => ''} 2023-03-11 22:54:17,100 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly aa39ddf65a193cbb3b88f447adacec76 2023-03-11 22:54:17,100 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678575242278.aa39ddf65a193cbb3b88f447adacec76.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-11 22:54:17,100 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for aa39ddf65a193cbb3b88f447adacec76 2023-03-11 22:54:17,101 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for aa39ddf65a193cbb3b88f447adacec76 2023-03-11 22:54:17,102 INFO [StoreOpener-aa39ddf65a193cbb3b88f447adacec76-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region aa39ddf65a193cbb3b88f447adacec76 2023-03-11 22:54:17,103 DEBUG [StoreOpener-aa39ddf65a193cbb3b88f447adacec76-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76/family1 2023-03-11 22:54:17,103 DEBUG [StoreOpener-aa39ddf65a193cbb3b88f447adacec76-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76/family1 2023-03-11 22:54:17,104 INFO [StoreOpener-aa39ddf65a193cbb3b88f447adacec76-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region aa39ddf65a193cbb3b88f447adacec76 columnFamilyName family1 2023-03-11 22:54:17,110 DEBUG [StoreOpener-aa39ddf65a193cbb3b88f447adacec76-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76/family1/5a07b1ad785c4421b5067f044af325bc 2023-03-11 22:54:17,110 INFO [StoreOpener-aa39ddf65a193cbb3b88f447adacec76-1] regionserver.HStore(310): Store=aa39ddf65a193cbb3b88f447adacec76/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-11 22:54:17,111 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76 2023-03-11 22:54:17,112 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76 2023-03-11 22:54:17,115 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for aa39ddf65a193cbb3b88f447adacec76 2023-03-11 22:54:17,116 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened aa39ddf65a193cbb3b88f447adacec76; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65151838, jitterRate=-0.029161959886550903}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-11 22:54:17,116 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for aa39ddf65a193cbb3b88f447adacec76: 2023-03-11 22:54:17,117 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678575242278.aa39ddf65a193cbb3b88f447adacec76., pid=47, masterSystemTime=1678575257097 2023-03-11 22:54:17,118 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678575242278.aa39ddf65a193cbb3b88f447adacec76. 2023-03-11 22:54:17,118 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678575242278.aa39ddf65a193cbb3b88f447adacec76. 2023-03-11 22:54:17,119 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=aa39ddf65a193cbb3b88f447adacec76, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:17,119 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678575242278.aa39ddf65a193cbb3b88f447adacec76.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1678575257119"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1678575257119"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678575257119"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678575257119"}]},"ts":"1678575257119"} 2023-03-11 22:54:17,122 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=47, resume processing ppid=45 2023-03-11 22:54:17,122 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=45, state=SUCCESS; OpenRegionProcedure aa39ddf65a193cbb3b88f447adacec76, server=jenkins-hbase20.apache.org,41843,1678575183185 in 175 msec 2023-03-11 22:54:17,127 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=44 2023-03-11 22:54:17,127 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=44, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=aa39ddf65a193cbb3b88f447adacec76, REOPEN/MOVE in 1.0910 sec 2023-03-11 22:54:17,131 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=43 2023-03-11 22:54:17,131 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=43, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.0990 sec 2023-03-11 22:54:17,133 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=43, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.5150 sec 2023-03-11 22:54:17,133 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1227): Checking to see if procedure is done pid=43 2023-03-11 22:54:17,134 INFO [Listener at localhost.localdomain/41563] compactions.TestMobCompactor(278): alter status finished 2023-03-11 22:54:17,135 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=44347] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:17,136 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-03-11 22:54:17,137 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-03-11 22:54:17,138 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-11 22:54:17,138 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1678575857138 2023-03-11 22:54:17,141 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-11 22:54:17,141 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-03-11 22:54:17,142 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-11 22:54:17,142 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] zookeeper.ReadOnlyZKClient(139): Connect 0x6e9841ec to 127.0.0.1:51815 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-11 22:54:17,157 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@698860aa, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-11 22:54:17,158 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-11 22:54:17,158 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-11 22:54:17,158 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-11 22:54:17,158 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-11 22:54:17,158 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-11 22:54:18,035 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511285da4284a56ac49d7a4cff3149f58c0e5 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511285da4284a56ac49d7a4cff3149f58c0e5 2023-03-11 22:54:18,036 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-11 22:54:18,053 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-11 22:54:18,054 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:41968, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-11 22:54:18,061 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-11 22:54:18,062 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:44320, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-11 22:54:18,073 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/dd807558e2604d1fa13ec20f91886b71 first=Optional[r05] last=Optional[r8] 2023-03-11 22:54:18,074 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678575242278.aa39ddf65a193cbb3b88f447adacec76., hostname=jenkins-hbase20.apache.org,41843,1678575183185, seqNum=51 for row with hfile group [{family1,hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/dd807558e2604d1fa13ec20f91886b71}] 2023-03-11 22:54:18,079 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/dd807558e2604d1fa13ec20f91886b71 for inclusion in aa39ddf65a193cbb3b88f447adacec76/family1 2023-03-11 22:54:18,082 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-03-11 22:54:18,082 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(777): Region bounds: first= last= 2023-03-11 22:54:18,082 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HRegion(2446): Flush status journal for aa39ddf65a193cbb3b88f447adacec76: 2023-03-11 22:54:18,083 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/dd807558e2604d1fa13ec20f91886b71 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__fqqfmm7q2qv1509tqll3sp62kfkfcuqpcfb1spj38eunl23n4adaj38b48a49tcd/family1/dd807558e2604d1fa13ec20f91886b71 2023-03-11 22:54:18,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__fqqfmm7q2qv1509tqll3sp62kfkfcuqpcfb1spj38eunl23n4adaj38b48a49tcd/family1/dd807558e2604d1fa13ec20f91886b71 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76/family1/a11cd2f6f3ea4355ac79df839970e2ca_SeqId_53_ 2023-03-11 22:54:18,088 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__fqqfmm7q2qv1509tqll3sp62kfkfcuqpcfb1spj38eunl23n4adaj38b48a49tcd/family1/dd807558e2604d1fa13ec20f91886b71 into aa39ddf65a193cbb3b88f447adacec76/family1 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76/family1/a11cd2f6f3ea4355ac79df839970e2ca_SeqId_53_ - updating store file list. 2023-03-11 22:54:18,092 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76/family1/a11cd2f6f3ea4355ac79df839970e2ca_SeqId_53_ into aa39ddf65a193cbb3b88f447adacec76/family1 2023-03-11 22:54:18,092 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__fqqfmm7q2qv1509tqll3sp62kfkfcuqpcfb1spj38eunl23n4adaj38b48a49tcd/family1/dd807558e2604d1fa13ec20f91886b71 into aa39ddf65a193cbb3b88f447adacec76/family1 (new location: hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76/family1/a11cd2f6f3ea4355ac79df839970e2ca_SeqId_53_) 2023-03-11 22:54:18,093 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__fqqfmm7q2qv1509tqll3sp62kfkfcuqpcfb1spj38eunl23n4adaj38b48a49tcd/family1/dd807558e2604d1fa13ec20f91886b71 2023-03-11 22:54:18,094 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-11 22:54:18,095 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 22:54:18,096 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151120256a6e89b71e409aa71c4422872a911e to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151120256a6e89b71e409aa71c4422872a911e 2023-03-11 22:54:18,097 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128c7a9c9343cfe4ac0a2e84a65eca88fd7 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128c7a9c9343cfe4ac0a2e84a65eca88fd7 2023-03-11 22:54:18,097 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2 expired mob files are deleted 2023-03-11 22:54:18,097 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-03-11 22:54:18,098 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-11 22:54:18,098 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-11 22:54:18,098 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-11 22:54:18,098 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-11 22:54:18,098 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-11 22:54:18,099 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-03-11 22:54:18,101 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 964 msec 2023-03-11 22:54:18,159 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.HMaster$12(2454): Client=jenkins//148.251.75.209 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-03-11 22:54:18,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:18,171 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000003 2023-03-11 22:54:18,172 DEBUG [PEWorker-4] util.FSTableDescriptors(519): Deleted hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-03-11 22:54:18,172 INFO [PEWorker-4] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000003 2023-03-11 22:54:18,175 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=49, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly}] 2023-03-11 22:54:18,177 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=aa39ddf65a193cbb3b88f447adacec76, REOPEN/MOVE}] 2023-03-11 22:54:18,178 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=aa39ddf65a193cbb3b88f447adacec76, REOPEN/MOVE 2023-03-11 22:54:18,178 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=aa39ddf65a193cbb3b88f447adacec76, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:18,179 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678575242278.aa39ddf65a193cbb3b88f447adacec76.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1678575258178"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1678575258178"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678575258178"}]},"ts":"1678575258178"} 2023-03-11 22:54:18,180 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE; CloseRegionProcedure aa39ddf65a193cbb3b88f447adacec76, server=jenkins-hbase20.apache.org,41843,1678575183185}] 2023-03-11 22:54:18,332 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close aa39ddf65a193cbb3b88f447adacec76 2023-03-11 22:54:18,332 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing aa39ddf65a193cbb3b88f447adacec76, disabling compactions & flushes 2023-03-11 22:54:18,332 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678575242278.aa39ddf65a193cbb3b88f447adacec76. 2023-03-11 22:54:18,332 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678575242278.aa39ddf65a193cbb3b88f447adacec76. 2023-03-11 22:54:18,332 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678575242278.aa39ddf65a193cbb3b88f447adacec76. after waiting 0 ms 2023-03-11 22:54:18,332 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678575242278.aa39ddf65a193cbb3b88f447adacec76. 2023-03-11 22:54:18,338 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-03-11 22:54:18,339 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678575242278.aa39ddf65a193cbb3b88f447adacec76. 2023-03-11 22:54:18,339 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for aa39ddf65a193cbb3b88f447adacec76: 2023-03-11 22:54:18,339 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(3509): Not adding moved region record: aa39ddf65a193cbb3b88f447adacec76 to self. 2023-03-11 22:54:18,341 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed aa39ddf65a193cbb3b88f447adacec76 2023-03-11 22:54:18,341 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=aa39ddf65a193cbb3b88f447adacec76, regionState=CLOSED 2023-03-11 22:54:18,341 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678575242278.aa39ddf65a193cbb3b88f447adacec76.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1678575258341"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678575258341"}]},"ts":"1678575258341"} 2023-03-11 22:54:18,343 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=51 2023-03-11 22:54:18,343 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; CloseRegionProcedure aa39ddf65a193cbb3b88f447adacec76, server=jenkins-hbase20.apache.org,41843,1678575183185 in 162 msec 2023-03-11 22:54:18,344 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=aa39ddf65a193cbb3b88f447adacec76, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase20.apache.org,41843,1678575183185; forceNewPlan=false, retain=true 2023-03-11 22:54:18,494 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=aa39ddf65a193cbb3b88f447adacec76, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:18,494 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678575242278.aa39ddf65a193cbb3b88f447adacec76.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1678575258494"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1678575258494"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678575258494"}]},"ts":"1678575258494"} 2023-03-11 22:54:18,496 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=51, state=RUNNABLE; OpenRegionProcedure aa39ddf65a193cbb3b88f447adacec76, server=jenkins-hbase20.apache.org,41843,1678575183185}] 2023-03-11 22:54:18,650 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678575242278.aa39ddf65a193cbb3b88f447adacec76. 2023-03-11 22:54:18,650 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => aa39ddf65a193cbb3b88f447adacec76, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678575242278.aa39ddf65a193cbb3b88f447adacec76.', STARTKEY => '', ENDKEY => ''} 2023-03-11 22:54:18,650 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly aa39ddf65a193cbb3b88f447adacec76 2023-03-11 22:54:18,651 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678575242278.aa39ddf65a193cbb3b88f447adacec76.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-11 22:54:18,651 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for aa39ddf65a193cbb3b88f447adacec76 2023-03-11 22:54:18,651 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for aa39ddf65a193cbb3b88f447adacec76 2023-03-11 22:54:18,652 INFO [StoreOpener-aa39ddf65a193cbb3b88f447adacec76-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region aa39ddf65a193cbb3b88f447adacec76 2023-03-11 22:54:18,653 DEBUG [StoreOpener-aa39ddf65a193cbb3b88f447adacec76-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76/family1 2023-03-11 22:54:18,653 DEBUG [StoreOpener-aa39ddf65a193cbb3b88f447adacec76-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76/family1 2023-03-11 22:54:18,653 INFO [StoreOpener-aa39ddf65a193cbb3b88f447adacec76-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region aa39ddf65a193cbb3b88f447adacec76 columnFamilyName family1 2023-03-11 22:54:18,660 DEBUG [StoreOpener-aa39ddf65a193cbb3b88f447adacec76-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76/family1/5a07b1ad785c4421b5067f044af325bc 2023-03-11 22:54:18,663 DEBUG [StoreOpener-aa39ddf65a193cbb3b88f447adacec76-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76/family1/a11cd2f6f3ea4355ac79df839970e2ca_SeqId_53_ 2023-03-11 22:54:18,664 INFO [StoreOpener-aa39ddf65a193cbb3b88f447adacec76-1] regionserver.HStore(310): Store=aa39ddf65a193cbb3b88f447adacec76/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-11 22:54:18,665 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76 2023-03-11 22:54:18,666 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76 2023-03-11 22:54:18,669 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for aa39ddf65a193cbb3b88f447adacec76 2023-03-11 22:54:18,669 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened aa39ddf65a193cbb3b88f447adacec76; next sequenceid=56; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68713876, jitterRate=0.023916542530059814}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-11 22:54:18,670 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for aa39ddf65a193cbb3b88f447adacec76: 2023-03-11 22:54:18,670 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678575242278.aa39ddf65a193cbb3b88f447adacec76., pid=53, masterSystemTime=1678575258648 2023-03-11 22:54:18,672 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678575242278.aa39ddf65a193cbb3b88f447adacec76. 2023-03-11 22:54:18,672 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678575242278.aa39ddf65a193cbb3b88f447adacec76. 2023-03-11 22:54:18,672 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=aa39ddf65a193cbb3b88f447adacec76, regionState=OPEN, openSeqNum=56, regionLocation=jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:18,672 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678575242278.aa39ddf65a193cbb3b88f447adacec76.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1678575258672"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1678575258672"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678575258672"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678575258672"}]},"ts":"1678575258672"} 2023-03-11 22:54:18,675 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=51 2023-03-11 22:54:18,675 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; OpenRegionProcedure aa39ddf65a193cbb3b88f447adacec76, server=jenkins-hbase20.apache.org,41843,1678575183185 in 178 msec 2023-03-11 22:54:18,677 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=51, resume processing ppid=50 2023-03-11 22:54:18,677 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=50, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=aa39ddf65a193cbb3b88f447adacec76, REOPEN/MOVE in 498 msec 2023-03-11 22:54:18,679 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=49 2023-03-11 22:54:18,679 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=49, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 502 msec 2023-03-11 22:54:18,681 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 520 msec 2023-03-11 22:54:18,681 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1227): Checking to see if procedure is done pid=49 2023-03-11 22:54:18,682 INFO [Listener at localhost.localdomain/41563] compactions.TestMobCompactor(278): alter status finished 2023-03-11 22:54:18,683 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=44347] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-11 22:54:18,685 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] procedure2.ProcedureExecutor(1029): Stored pid=54, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-03-11 22:54:18,686 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=54, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-03-11 22:54:18,686 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=54, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1678575858686 2023-03-11 22:54:18,686 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-11 22:54:18,687 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-11 22:54:18,687 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 4 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-03-11 22:54:18,687 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-11 22:54:18,688 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] zookeeper.ReadOnlyZKClient(139): Connect 0x517b638f to 127.0.0.1:51815 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-11 22:54:18,691 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7bdcc43a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-11 22:54:18,691 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-11 22:54:18,691 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-11 22:54:18,691 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-11 22:54:18,691 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-11 22:54:18,691 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-11 22:54:18,691 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-11 22:54:18,692 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-11 22:54:18,692 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-11 22:54:18,692 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-11 22:54:18,692 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-11 22:54:18,693 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=54, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-03-11 22:54:18,694 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=54, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 9 msec 2023-03-11 22:54:18,746 INFO [Listener at localhost.localdomain/41563] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly Thread=243 (was 251), OpenFileDescriptor=617 (was 604) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=252 (was 254), ProcessCount=168 (was 168), AvailableMemoryMB=21549 (was 21644) 2023-03-11 22:54:18,758 INFO [Listener at localhost.localdomain/41563] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily Thread=243, OpenFileDescriptor=617, MaxFileDescriptor=60000, SystemLoadAverage=252, ProcessCount=168, AvailableMemoryMB=21549 2023-03-11 22:54:18,760 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-03-11 22:54:18,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure2.ProcedureExecutor(1029): Stored pid=55, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:18,763 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_PRE_OPERATION 2023-03-11 22:54:18,763 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(697): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily" procId is: 55 2023-03-11 22:54:18,763 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-11 22:54:18,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-03-11 22:54:18,765 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32 2023-03-11 22:54:18,765 DEBUG [HFileArchiver-10] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32 empty. 2023-03-11 22:54:18,766 DEBUG [HFileArchiver-10] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32 2023-03-11 22:54:18,766 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily regions 2023-03-11 22:54:18,780 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000001 2023-03-11 22:54:18,781 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(7675): creating {ENCODED => db89d2511291454c79f34c24761dad32, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678575258760.db89d2511291454c79f34c24761dad32.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/.tmp 2023-03-11 22:54:18,796 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678575258760.db89d2511291454c79f34c24761dad32.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-11 22:54:18,796 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1604): Closing db89d2511291454c79f34c24761dad32, disabling compactions & flushes 2023-03-11 22:54:18,796 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678575258760.db89d2511291454c79f34c24761dad32. 2023-03-11 22:54:18,796 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678575258760.db89d2511291454c79f34c24761dad32. 2023-03-11 22:54:18,796 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678575258760.db89d2511291454c79f34c24761dad32. after waiting 0 ms 2023-03-11 22:54:18,796 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678575258760.db89d2511291454c79f34c24761dad32. 2023-03-11 22:54:18,796 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678575258760.db89d2511291454c79f34c24761dad32. 2023-03-11 22:54:18,797 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1558): Region close journal for db89d2511291454c79f34c24761dad32: 2023-03-11 22:54:18,799 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_ADD_TO_META 2023-03-11 22:54:18,801 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678575258760.db89d2511291454c79f34c24761dad32.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1678575258800"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678575258800"}]},"ts":"1678575258800"} 2023-03-11 22:54:18,802 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-03-11 22:54:18,803 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-11 22:54:18,804 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678575258803"}]},"ts":"1678575258803"} 2023-03-11 22:54:18,805 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, state=ENABLING in hbase:meta 2023-03-11 22:54:18,807 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=db89d2511291454c79f34c24761dad32, ASSIGN}] 2023-03-11 22:54:18,810 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=db89d2511291454c79f34c24761dad32, ASSIGN 2023-03-11 22:54:18,812 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=db89d2511291454c79f34c24761dad32, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,41843,1678575183185; forceNewPlan=false, retain=false 2023-03-11 22:54:18,865 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-03-11 22:54:18,963 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=56 updating hbase:meta row=db89d2511291454c79f34c24761dad32, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:18,963 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678575258760.db89d2511291454c79f34c24761dad32.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1678575258963"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1678575258963"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678575258963"}]},"ts":"1678575258963"} 2023-03-11 22:54:18,964 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=57, ppid=56, state=RUNNABLE; OpenRegionProcedure db89d2511291454c79f34c24761dad32, server=jenkins-hbase20.apache.org,41843,1678575183185}] 2023-03-11 22:54:19,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-03-11 22:54:19,119 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678575258760.db89d2511291454c79f34c24761dad32. 2023-03-11 22:54:19,119 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => db89d2511291454c79f34c24761dad32, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678575258760.db89d2511291454c79f34c24761dad32.', STARTKEY => '', ENDKEY => ''} 2023-03-11 22:54:19,119 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily db89d2511291454c79f34c24761dad32 2023-03-11 22:54:19,119 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678575258760.db89d2511291454c79f34c24761dad32.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-11 22:54:19,119 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for db89d2511291454c79f34c24761dad32 2023-03-11 22:54:19,119 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for db89d2511291454c79f34c24761dad32 2023-03-11 22:54:19,120 INFO [StoreOpener-db89d2511291454c79f34c24761dad32-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region db89d2511291454c79f34c24761dad32 2023-03-11 22:54:19,121 DEBUG [StoreOpener-db89d2511291454c79f34c24761dad32-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32/family1 2023-03-11 22:54:19,122 DEBUG [StoreOpener-db89d2511291454c79f34c24761dad32-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32/family1 2023-03-11 22:54:19,122 INFO [StoreOpener-db89d2511291454c79f34c24761dad32-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region db89d2511291454c79f34c24761dad32 columnFamilyName family1 2023-03-11 22:54:19,123 INFO [StoreOpener-db89d2511291454c79f34c24761dad32-1] regionserver.HStore(310): Store=db89d2511291454c79f34c24761dad32/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-11 22:54:19,124 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32 2023-03-11 22:54:19,124 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32 2023-03-11 22:54:19,127 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for db89d2511291454c79f34c24761dad32 2023-03-11 22:54:19,129 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-11 22:54:19,129 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened db89d2511291454c79f34c24761dad32; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69177187, jitterRate=0.030820414423942566}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-11 22:54:19,129 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for db89d2511291454c79f34c24761dad32: 2023-03-11 22:54:19,130 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678575258760.db89d2511291454c79f34c24761dad32., pid=57, masterSystemTime=1678575259116 2023-03-11 22:54:19,131 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678575258760.db89d2511291454c79f34c24761dad32. 2023-03-11 22:54:19,131 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678575258760.db89d2511291454c79f34c24761dad32. 2023-03-11 22:54:19,131 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=56 updating hbase:meta row=db89d2511291454c79f34c24761dad32, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:19,131 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678575258760.db89d2511291454c79f34c24761dad32.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1678575259131"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1678575259131"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678575259131"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678575259131"}]},"ts":"1678575259131"} 2023-03-11 22:54:19,133 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=57, resume processing ppid=56 2023-03-11 22:54:19,133 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=57, ppid=56, state=SUCCESS; OpenRegionProcedure db89d2511291454c79f34c24761dad32, server=jenkins-hbase20.apache.org,41843,1678575183185 in 168 msec 2023-03-11 22:54:19,134 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=56, resume processing ppid=55 2023-03-11 22:54:19,134 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=56, ppid=55, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=db89d2511291454c79f34c24761dad32, ASSIGN in 326 msec 2023-03-11 22:54:19,135 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-11 22:54:19,135 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678575259135"}]},"ts":"1678575259135"} 2023-03-11 22:54:19,136 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, state=ENABLED in hbase:meta 2023-03-11 22:54:19,137 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_POST_OPERATION 2023-03-11 22:54:19,138 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=55, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 376 msec 2023-03-11 22:54:19,367 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-03-11 22:54:19,367 INFO [Listener at localhost.localdomain/41563] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, procId: 55 completed 2023-03-11 22:54:19,394 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-11 22:54:19,400 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:19,400 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-11 22:54:19,400 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:54:19,400 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-03-11 22:54:19,400 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-03-11 22:54:19,400 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:19,400 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:19,401 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:54:19,401 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:19,401 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:54:19,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:54:19,402 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:19,402 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 22:54:19,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:19,402 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:19,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 22:54:19,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:19,402 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:19,403 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:19,403 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-03-11 22:54:19,403 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:54:19,403 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-03-11 22:54:19,403 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 22:54:19,403 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 22:54:19,403 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678575258760.db89d2511291454c79f34c24761dad32. 2023-03-11 22:54:19,403 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678575258760.db89d2511291454c79f34c24761dad32. started... 2023-03-11 22:54:19,404 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing db89d2511291454c79f34c24761dad32 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-03-11 22:54:19,441 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511305b0d9bf432d843c4beea43dd82adb296 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511305b0d9bf432d843c4beea43dd82adb296 2023-03-11 22:54:19,445 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32/.tmp/family1/5dc74fcfbcbb4c0e88c33a1294b30dd9 2023-03-11 22:54:19,449 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32/.tmp/family1/5dc74fcfbcbb4c0e88c33a1294b30dd9 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32/family1/5dc74fcfbcbb4c0e88c33a1294b30dd9 2023-03-11 22:54:19,453 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32/family1/5dc74fcfbcbb4c0e88c33a1294b30dd9, entries=1000, sequenceid=5, filesize=190.5 K 2023-03-11 22:54:19,454 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for db89d2511291454c79f34c24761dad32 in 50ms, sequenceid=5, compaction requested=false 2023-03-11 22:54:19,454 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-11 22:54:19,455 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for db89d2511291454c79f34c24761dad32: 2023-03-11 22:54:19,455 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678575258760.db89d2511291454c79f34c24761dad32. 2023-03-11 22:54:19,455 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 22:54:19,455 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 22:54:19,455 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:19,455 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-03-11 22:54:19,455 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-03-11 22:54:19,456 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:19,456 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:19,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:19,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:54:19,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:54:19,456 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:19,456 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 22:54:19,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:54:19,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:54:19,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:19,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:19,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:54:19,457 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-03-11 22:54:19,457 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-03-11 22:54:19,457 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@35bbd74a[Count = 0] remaining members to acquire global barrier 2023-03-11 22:54:19,458 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:19,458 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:19,458 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:19,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:19,458 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-03-11 22:54:19,458 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-03-11 22:54:19,458 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:19,459 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 22:54:19,458 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,41843,1678575183185' in zk 2023-03-11 22:54:19,459 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:19,459 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-03-11 22:54:19,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:19,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:54:19,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:54:19,459 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:54:19,459 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-03-11 22:54:19,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:54:19,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:54:19,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:19,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:19,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:54:19,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:19,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:19,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,41843,1678575183185': 2023-03-11 22:54:19,461 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-03-11 22:54:19,461 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-03-11 22:54:19,461 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 22:54:19,461 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 22:54:19,461 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:19,461 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 22:54:19,462 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:19,462 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:19,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:19,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:54:19,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:54:19,462 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:19,462 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:54:19,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:19,463 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:19,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:54:19,463 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:54:19,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:54:19,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:19,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:19,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:54:19,464 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:19,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:19,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:19,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:54:19,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:19,466 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:19,466 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:54:19,466 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:19,466 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:54:19,466 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-11 22:54:19,466 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 22:54:19,466 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:19,466 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:54:19,466 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-03-11 22:54:19,466 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:54:19,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:54:19,466 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:19,467 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-03-11 22:54:19,467 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:19,467 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:54:19,467 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 22:54:19,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:54:19,467 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:19,467 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:19,567 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 22:54:19,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 22:54:19,571 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-11 22:54:19,573 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-03-11 22:54:19,573 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:19,573 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-11 22:54:19,573 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:54:19,573 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-03-11 22:54:19,573 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-03-11 22:54:19,573 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:19,573 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:19,574 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:19,574 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:54:19,574 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:54:19,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:54:19,574 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:19,574 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 22:54:19,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:19,575 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:19,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 22:54:19,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:19,575 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:19,575 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-03-11 22:54:19,575 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:19,576 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-03-11 22:54:19,576 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:54:19,576 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-03-11 22:54:19,576 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 22:54:19,576 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 22:54:19,576 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678575258760.db89d2511291454c79f34c24761dad32. 2023-03-11 22:54:19,576 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678575258760.db89d2511291454c79f34c24761dad32. started... 2023-03-11 22:54:19,576 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing db89d2511291454c79f34c24761dad32 1/1 column families, dataSize=74 B heapSize=408 B 2023-03-11 22:54:19,989 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112847bd931e052045799f4b208d5a9f703b to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015112847bd931e052045799f4b208d5a9f703b 2023-03-11 22:54:20,401 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32/.tmp/family1/853ef8a830ea4bf0b5a65be6e61097a7 2023-03-11 22:54:20,412 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32/.tmp/family1/853ef8a830ea4bf0b5a65be6e61097a7 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32/family1/853ef8a830ea4bf0b5a65be6e61097a7 2023-03-11 22:54:20,419 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32/family1/853ef8a830ea4bf0b5a65be6e61097a7, entries=1, sequenceid=9, filesize=5.0 K 2023-03-11 22:54:20,420 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for db89d2511291454c79f34c24761dad32 in 844ms, sequenceid=9, compaction requested=false 2023-03-11 22:54:20,420 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for db89d2511291454c79f34c24761dad32: 2023-03-11 22:54:20,420 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678575258760.db89d2511291454c79f34c24761dad32. 2023-03-11 22:54:20,420 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 22:54:20,420 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 22:54:20,420 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:20,420 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-03-11 22:54:20,420 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-03-11 22:54:20,422 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:20,422 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:20,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:20,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:54:20,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:54:20,422 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:20,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:54:20,422 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 22:54:20,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:54:20,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:20,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:20,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:54:20,424 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-03-11 22:54:20,425 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@f13b390[Count = 0] remaining members to acquire global barrier 2023-03-11 22:54:20,425 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-03-11 22:54:20,425 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:20,426 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:20,426 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:20,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:20,426 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-03-11 22:54:20,426 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-03-11 22:54:20,426 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:20,426 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 22:54:20,426 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,41843,1678575183185' in zk 2023-03-11 22:54:20,427 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:20,427 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-03-11 22:54:20,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:20,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:54:20,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:54:20,427 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:54:20,427 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-03-11 22:54:20,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:54:20,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:54:20,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:20,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:20,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:54:20,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:20,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:20,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,41843,1678575183185': 2023-03-11 22:54:20,430 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-03-11 22:54:20,430 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-03-11 22:54:20,430 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 22:54:20,430 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 22:54:20,430 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:20,430 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 22:54:20,431 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:20,431 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:20,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:20,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:54:20,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:54:20,431 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:20,431 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:54:20,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:20,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:54:20,431 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:20,431 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:54:20,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:54:20,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:20,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:20,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:54:20,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:20,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:20,432 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:20,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:54:20,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:20,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:20,434 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:20,434 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:54:20,434 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:20,434 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:54:20,434 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:54:20,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:54:20,434 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-11 22:54:20,434 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 22:54:20,434 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:20,434 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:54:20,434 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:20,434 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:54:20,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:54:20,434 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:20,434 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:20,434 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:20,434 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-03-11 22:54:20,434 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 22:54:20,534 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 22:54:20,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 22:54:20,541 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-11 22:54:20,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-03-11 22:54:20,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:20,543 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-11 22:54:20,543 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:54:20,543 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-03-11 22:54:20,544 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-03-11 22:54:20,544 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:20,544 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:20,545 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:20,545 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:54:20,546 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:54:20,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:54:20,546 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:20,546 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 22:54:20,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:20,547 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:20,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 22:54:20,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:20,548 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:20,548 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-03-11 22:54:20,548 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:20,548 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-03-11 22:54:20,548 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:54:20,549 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-03-11 22:54:20,549 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 22:54:20,549 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 22:54:20,549 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678575258760.db89d2511291454c79f34c24761dad32. 2023-03-11 22:54:20,549 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678575258760.db89d2511291454c79f34c24761dad32. started... 2023-03-11 22:54:20,549 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing db89d2511291454c79f34c24761dad32 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-11 22:54:20,967 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201f6322c8aa5484718b25ef18385da4210 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151201f6322c8aa5484718b25ef18385da4210 2023-03-11 22:54:21,374 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32/.tmp/family1/616ca27938d34b468509aa15b6ec9341 2023-03-11 22:54:21,378 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32/.tmp/family1/616ca27938d34b468509aa15b6ec9341 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32/family1/616ca27938d34b468509aa15b6ec9341 2023-03-11 22:54:21,382 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32/family1/616ca27938d34b468509aa15b6ec9341, entries=1, sequenceid=13, filesize=5.0 K 2023-03-11 22:54:21,383 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for db89d2511291454c79f34c24761dad32 in 834ms, sequenceid=13, compaction requested=true 2023-03-11 22:54:21,383 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for db89d2511291454c79f34c24761dad32: 2023-03-11 22:54:21,383 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678575258760.db89d2511291454c79f34c24761dad32. 2023-03-11 22:54:21,383 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 22:54:21,383 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 22:54:21,383 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:21,383 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-03-11 22:54:21,383 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-03-11 22:54:21,384 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:21,384 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:21,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:21,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:54:21,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:54:21,384 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:21,384 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 22:54:21,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:54:21,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:54:21,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:21,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:21,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:54:21,385 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-03-11 22:54:21,385 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-03-11 22:54:21,385 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@26ff9b91[Count = 0] remaining members to acquire global barrier 2023-03-11 22:54:21,385 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:21,386 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:21,386 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:21,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:21,386 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-03-11 22:54:21,386 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-03-11 22:54:21,386 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,41843,1678575183185' in zk 2023-03-11 22:54:21,386 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:21,386 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 22:54:21,387 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-03-11 22:54:21,387 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:21,387 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:54:21,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:21,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:54:21,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:54:21,387 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-03-11 22:54:21,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:54:21,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:54:21,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:21,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:21,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:54:21,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:21,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:21,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,41843,1678575183185': 2023-03-11 22:54:21,388 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-03-11 22:54:21,388 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-03-11 22:54:21,389 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 22:54:21,389 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 22:54:21,389 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:21,389 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 22:54:21,389 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:21,389 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:21,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:21,389 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:21,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:54:21,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:54:21,389 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:54:21,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:21,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:54:21,390 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:54:21,390 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:21,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:54:21,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:21,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:21,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:54:21,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:21,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:21,391 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:21,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:54:21,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:21,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:21,392 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:21,392 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:54:21,392 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:21,392 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:54:21,392 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-11 22:54:21,392 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 22:54:21,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:54:21,392 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-03-11 22:54:21,392 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:54:21,392 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:21,392 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:54:21,392 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-03-11 22:54:21,393 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:54:21,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:54:21,392 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:21,393 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 22:54:21,393 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:21,393 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:21,393 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:21,493 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 22:54:21,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 22:54:21,498 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-11 22:54:21,500 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-03-11 22:54:21,500 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:21,500 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-11 22:54:21,500 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:54:21,501 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-03-11 22:54:21,501 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-03-11 22:54:21,501 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:21,502 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:21,503 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:54:21,503 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:21,503 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:54:21,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:54:21,504 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:21,504 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 22:54:21,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:21,504 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:21,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 22:54:21,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:21,505 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:21,505 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-03-11 22:54:21,505 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:21,505 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-03-11 22:54:21,505 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:54:21,505 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-03-11 22:54:21,506 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 22:54:21,506 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 22:54:21,506 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678575258760.db89d2511291454c79f34c24761dad32. 2023-03-11 22:54:21,506 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678575258760.db89d2511291454c79f34c24761dad32. started... 2023-03-11 22:54:21,506 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing db89d2511291454c79f34c24761dad32 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-11 22:54:21,920 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205123a34f2fcec421b972ae350d1ef0729 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151205123a34f2fcec421b972ae350d1ef0729 2023-03-11 22:54:22,327 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32/.tmp/family1/62dd0da08e2341e4b8d069be4ae839e3 2023-03-11 22:54:22,334 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-11 22:54:22,338 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32/.tmp/family1/62dd0da08e2341e4b8d069be4ae839e3 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32/family1/62dd0da08e2341e4b8d069be4ae839e3 2023-03-11 22:54:22,344 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32/family1/62dd0da08e2341e4b8d069be4ae839e3, entries=1, sequenceid=17, filesize=5.0 K 2023-03-11 22:54:22,345 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for db89d2511291454c79f34c24761dad32 in 839ms, sequenceid=17, compaction requested=true 2023-03-11 22:54:22,345 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for db89d2511291454c79f34c24761dad32: 2023-03-11 22:54:22,345 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678575258760.db89d2511291454c79f34c24761dad32. 2023-03-11 22:54:22,345 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 22:54:22,345 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 22:54:22,345 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:22,345 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-03-11 22:54:22,345 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-03-11 22:54:22,348 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:22,348 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:22,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:22,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:54:22,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:54:22,348 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:22,348 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 22:54:22,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:54:22,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:54:22,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:22,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:22,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:54:22,350 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-03-11 22:54:22,350 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-03-11 22:54:22,350 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1bacc3a0[Count = 0] remaining members to acquire global barrier 2023-03-11 22:54:22,350 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:22,350 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:22,350 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:22,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:22,350 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-03-11 22:54:22,350 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-03-11 22:54:22,350 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:22,350 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 22:54:22,350 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,41843,1678575183185' in zk 2023-03-11 22:54:22,351 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-03-11 22:54:22,351 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:22,351 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:54:22,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:22,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:54:22,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:54:22,351 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-03-11 22:54:22,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:54:22,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:54:22,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:22,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:22,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:54:22,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:22,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:22,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,41843,1678575183185': 2023-03-11 22:54:22,353 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-03-11 22:54:22,353 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-03-11 22:54:22,353 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 22:54:22,353 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 22:54:22,353 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:22,353 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 22:54:22,354 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:22,354 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:22,354 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:22,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:22,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:54:22,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:54:22,354 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:54:22,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:22,354 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:22,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:54:22,354 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:54:22,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:54:22,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:22,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:22,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:54:22,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:22,355 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:22,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:22,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:54:22,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:22,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:22,356 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:54:22,356 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:22,356 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:54:22,356 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:54:22,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:54:22,356 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-03-11 22:54:22,356 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:22,356 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-11 22:54:22,357 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 22:54:22,356 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:54:22,357 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:54:22,356 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:22,357 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:22,357 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:22,357 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:22,357 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:22,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:54:22,357 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-03-11 22:54:22,357 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 22:54:22,457 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 22:54:22,458 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 22:54:22,462 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-11 22:54:22,463 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-03-11 22:54:22,463 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:22,464 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-11 22:54:22,464 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:54:22,464 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-03-11 22:54:22,464 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-03-11 22:54:22,464 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:22,464 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:22,465 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:22,465 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:54:22,466 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:54:22,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:54:22,466 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:22,466 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 22:54:22,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:22,466 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:22,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 22:54:22,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:22,467 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:22,467 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-03-11 22:54:22,467 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:22,467 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-03-11 22:54:22,467 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:54:22,467 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-03-11 22:54:22,467 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 22:54:22,467 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 22:54:22,468 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678575258760.db89d2511291454c79f34c24761dad32. 2023-03-11 22:54:22,468 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678575258760.db89d2511291454c79f34c24761dad32. started... 2023-03-11 22:54:22,468 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing db89d2511291454c79f34c24761dad32 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-11 22:54:22,881 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228970122c09b9045fa8450bd95a9d722dc to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151228970122c09b9045fa8450bd95a9d722dc 2023-03-11 22:54:23,287 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32/.tmp/family1/79290cc44ad049d5bd0bd013621aeeb3 2023-03-11 22:54:23,300 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32/.tmp/family1/79290cc44ad049d5bd0bd013621aeeb3 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32/family1/79290cc44ad049d5bd0bd013621aeeb3 2023-03-11 22:54:23,307 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32/family1/79290cc44ad049d5bd0bd013621aeeb3, entries=1, sequenceid=21, filesize=5.0 K 2023-03-11 22:54:23,308 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for db89d2511291454c79f34c24761dad32 in 840ms, sequenceid=21, compaction requested=true 2023-03-11 22:54:23,308 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for db89d2511291454c79f34c24761dad32: 2023-03-11 22:54:23,308 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678575258760.db89d2511291454c79f34c24761dad32. 2023-03-11 22:54:23,308 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 22:54:23,308 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 22:54:23,308 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:23,308 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-03-11 22:54:23,308 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-03-11 22:54:23,309 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:23,309 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:23,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:23,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:54:23,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:54:23,310 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:23,310 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 22:54:23,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:54:23,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:54:23,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:23,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:23,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:54:23,312 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-03-11 22:54:23,312 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@70c65618[Count = 0] remaining members to acquire global barrier 2023-03-11 22:54:23,312 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-03-11 22:54:23,312 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:23,313 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:23,313 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:23,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:23,313 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-03-11 22:54:23,313 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-03-11 22:54:23,313 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,41843,1678575183185' in zk 2023-03-11 22:54:23,313 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:23,313 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 22:54:23,314 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:23,314 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-03-11 22:54:23,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:23,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:54:23,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:54:23,314 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:54:23,314 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-03-11 22:54:23,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:54:23,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:54:23,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:23,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:23,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:54:23,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:23,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:23,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,41843,1678575183185': 2023-03-11 22:54:23,317 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-03-11 22:54:23,317 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-03-11 22:54:23,317 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 22:54:23,317 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 22:54:23,317 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:23,317 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 22:54:23,318 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:23,318 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:23,318 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:54:23,318 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:23,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:23,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:23,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:54:23,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:54:23,319 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:54:23,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:54:23,319 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:23,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:54:23,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:23,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:23,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:54:23,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:23,320 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:23,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:23,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:54:23,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:23,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:23,323 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:23,323 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:54:23,323 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:23,323 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:54:23,323 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:54:23,323 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:54:23,323 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-03-11 22:54:23,323 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-11 22:54:23,323 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 22:54:23,323 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:23,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:54:23,323 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:23,323 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:23,323 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:23,323 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-03-11 22:54:23,323 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:23,324 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:54:23,324 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 22:54:23,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:54:23,424 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 22:54:23,426 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 22:54:23,434 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-11 22:54:23,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-03-11 22:54:23,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:23,437 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-11 22:54:23,437 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:54:23,438 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-03-11 22:54:23,438 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-03-11 22:54:23,438 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:23,438 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:23,439 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:23,439 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:54:23,439 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:54:23,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:54:23,439 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:23,439 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 22:54:23,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:23,440 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:23,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 22:54:23,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:23,440 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:23,441 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-03-11 22:54:23,441 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:23,441 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-03-11 22:54:23,441 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:54:23,441 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-03-11 22:54:23,441 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 22:54:23,441 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 22:54:23,441 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678575258760.db89d2511291454c79f34c24761dad32. 2023-03-11 22:54:23,441 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678575258760.db89d2511291454c79f34c24761dad32. started... 2023-03-11 22:54:23,442 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing db89d2511291454c79f34c24761dad32 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-11 22:54:23,861 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015123129cf7482049a456aaaed5ff223184adf to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015123129cf7482049a456aaaed5ff223184adf 2023-03-11 22:54:24,268 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32/.tmp/family1/1448dc9daffb49d59c71a42a8517f707 2023-03-11 22:54:24,273 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32/.tmp/family1/1448dc9daffb49d59c71a42a8517f707 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32/family1/1448dc9daffb49d59c71a42a8517f707 2023-03-11 22:54:24,278 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32/family1/1448dc9daffb49d59c71a42a8517f707, entries=1, sequenceid=25, filesize=5.0 K 2023-03-11 22:54:24,279 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for db89d2511291454c79f34c24761dad32 in 837ms, sequenceid=25, compaction requested=true 2023-03-11 22:54:24,279 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for db89d2511291454c79f34c24761dad32: 2023-03-11 22:54:24,279 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678575258760.db89d2511291454c79f34c24761dad32. 2023-03-11 22:54:24,279 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 22:54:24,279 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 22:54:24,279 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:24,279 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-03-11 22:54:24,279 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-03-11 22:54:24,280 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:24,280 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:24,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:24,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:54:24,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:54:24,281 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:24,281 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 22:54:24,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:54:24,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:54:24,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:24,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:24,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:54:24,282 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-03-11 22:54:24,282 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@62dbf4a3[Count = 0] remaining members to acquire global barrier 2023-03-11 22:54:24,282 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-03-11 22:54:24,282 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:24,282 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:24,283 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:24,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:24,283 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:24,283 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 22:54:24,283 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-03-11 22:54:24,283 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-03-11 22:54:24,283 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,41843,1678575183185' in zk 2023-03-11 22:54:24,283 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:24,283 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-03-11 22:54:24,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:24,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:54:24,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:54:24,284 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:54:24,284 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-03-11 22:54:24,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:54:24,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:54:24,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:24,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:24,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:54:24,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:24,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:24,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,41843,1678575183185': 2023-03-11 22:54:24,285 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-03-11 22:54:24,285 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-03-11 22:54:24,285 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 22:54:24,285 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 22:54:24,286 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:24,286 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 22:54:24,287 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:24,287 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:24,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:24,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:54:24,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:54:24,287 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:24,287 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:54:24,288 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:24,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:24,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:54:24,288 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:54:24,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:54:24,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:24,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:24,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:54:24,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:24,289 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:24,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:24,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:54:24,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:24,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:24,290 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:24,290 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:54:24,290 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:24,291 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:54:24,291 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-11 22:54:24,291 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 22:54:24,291 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:24,290 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:54:24,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:54:24,290 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:54:24,291 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-03-11 22:54:24,291 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:24,291 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-03-11 22:54:24,291 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:54:24,291 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:24,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:54:24,291 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 22:54:24,291 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:24,291 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:24,391 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 22:54:24,392 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 22:54:24,398 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-11 22:54:24,400 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-03-11 22:54:24,400 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:24,400 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-11 22:54:24,401 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:54:24,401 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-03-11 22:54:24,401 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-03-11 22:54:24,401 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:24,401 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:24,403 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:54:24,403 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:24,403 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:54:24,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:54:24,403 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:24,403 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 22:54:24,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:24,404 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:24,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 22:54:24,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:24,404 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:24,404 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-03-11 22:54:24,404 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:24,405 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-03-11 22:54:24,405 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:54:24,405 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-03-11 22:54:24,405 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 22:54:24,405 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 22:54:24,405 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678575258760.db89d2511291454c79f34c24761dad32. 2023-03-11 22:54:24,405 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678575258760.db89d2511291454c79f34c24761dad32. started... 2023-03-11 22:54:24,405 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing db89d2511291454c79f34c24761dad32 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-11 22:54:24,825 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101d7b89272c22b4097a700a39d0d9cfca4 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160101d7b89272c22b4097a700a39d0d9cfca4 2023-03-11 22:54:25,232 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32/.tmp/family1/5c18248b695144299811c63cdb0cbe52 2023-03-11 22:54:25,244 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32/.tmp/family1/5c18248b695144299811c63cdb0cbe52 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32/family1/5c18248b695144299811c63cdb0cbe52 2023-03-11 22:54:25,249 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32/family1/5c18248b695144299811c63cdb0cbe52, entries=1, sequenceid=29, filesize=5.0 K 2023-03-11 22:54:25,250 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for db89d2511291454c79f34c24761dad32 in 845ms, sequenceid=29, compaction requested=true 2023-03-11 22:54:25,251 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for db89d2511291454c79f34c24761dad32: 2023-03-11 22:54:25,251 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678575258760.db89d2511291454c79f34c24761dad32. 2023-03-11 22:54:25,251 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 22:54:25,251 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 22:54:25,251 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:25,251 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-03-11 22:54:25,251 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-03-11 22:54:25,252 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:25,252 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:25,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:25,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:54:25,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:54:25,253 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:25,253 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 22:54:25,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:54:25,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:54:25,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:25,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:25,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:54:25,254 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-03-11 22:54:25,254 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3822c87a[Count = 0] remaining members to acquire global barrier 2023-03-11 22:54:25,254 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-03-11 22:54:25,254 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:25,255 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:25,255 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:25,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:25,255 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-03-11 22:54:25,255 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-03-11 22:54:25,255 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,41843,1678575183185' in zk 2023-03-11 22:54:25,256 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:25,256 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 22:54:25,256 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-03-11 22:54:25,256 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:54:25,256 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:25,256 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-03-11 22:54:25,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:25,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:54:25,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:54:25,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:54:25,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:54:25,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:25,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:25,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:54:25,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:25,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:25,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,41843,1678575183185': 2023-03-11 22:54:25,260 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-03-11 22:54:25,260 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-03-11 22:54:25,260 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 22:54:25,260 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 22:54:25,260 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:25,260 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 22:54:25,261 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:25,261 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:25,261 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:25,261 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:54:25,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:25,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:25,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:54:25,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:54:25,262 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:54:25,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:54:25,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:54:25,262 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:25,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:25,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:25,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:54:25,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:25,264 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:25,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:25,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:54:25,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:25,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:25,266 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:25,266 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:25,267 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:25,266 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:54:25,267 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-11 22:54:25,267 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 22:54:25,267 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:54:25,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:54:25,267 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:54:25,267 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-03-11 22:54:25,267 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:54:25,267 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:25,267 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-03-11 22:54:25,267 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:54:25,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:54:25,267 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:25,267 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 22:54:25,268 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:25,268 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:25,368 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 22:54:25,369 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 22:54:25,373 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-11 22:54:25,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-03-11 22:54:25,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:25,376 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-11 22:54:25,376 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:54:25,376 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-03-11 22:54:25,376 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-03-11 22:54:25,377 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:25,377 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:25,378 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:54:25,378 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:25,378 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:54:25,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:54:25,378 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:25,379 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 22:54:25,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:25,379 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:25,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 22:54:25,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:25,379 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:25,379 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-03-11 22:54:25,380 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:25,380 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-03-11 22:54:25,380 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:54:25,380 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-03-11 22:54:25,382 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 22:54:25,382 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 22:54:25,382 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678575258760.db89d2511291454c79f34c24761dad32. 2023-03-11 22:54:25,382 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678575258760.db89d2511291454c79f34c24761dad32. started... 2023-03-11 22:54:25,382 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing db89d2511291454c79f34c24761dad32 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-11 22:54:25,804 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103c76365b7d32e49068e7bfa91857ae128 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160103c76365b7d32e49068e7bfa91857ae128 2023-03-11 22:54:26,211 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32/.tmp/family1/714f702e7fcb490aab820d9987619b0d 2023-03-11 22:54:26,219 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32/.tmp/family1/714f702e7fcb490aab820d9987619b0d as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32/family1/714f702e7fcb490aab820d9987619b0d 2023-03-11 22:54:26,227 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32/family1/714f702e7fcb490aab820d9987619b0d, entries=1, sequenceid=33, filesize=5.0 K 2023-03-11 22:54:26,228 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for db89d2511291454c79f34c24761dad32 in 846ms, sequenceid=33, compaction requested=true 2023-03-11 22:54:26,228 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for db89d2511291454c79f34c24761dad32: 2023-03-11 22:54:26,229 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678575258760.db89d2511291454c79f34c24761dad32. 2023-03-11 22:54:26,229 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 22:54:26,229 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 22:54:26,229 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:26,229 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-03-11 22:54:26,229 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-03-11 22:54:26,231 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:26,231 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:26,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:26,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:54:26,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:54:26,232 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:26,232 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 22:54:26,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:54:26,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:54:26,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:26,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:26,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:54:26,234 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-03-11 22:54:26,234 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@456ead1d[Count = 0] remaining members to acquire global barrier 2023-03-11 22:54:26,234 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-03-11 22:54:26,234 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:26,235 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:26,235 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:26,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:26,235 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-03-11 22:54:26,235 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-03-11 22:54:26,235 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,41843,1678575183185' in zk 2023-03-11 22:54:26,235 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:26,235 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 22:54:26,236 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:26,236 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-03-11 22:54:26,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:26,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:54:26,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:54:26,236 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:54:26,236 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-03-11 22:54:26,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:54:26,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:54:26,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:26,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:26,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:54:26,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:26,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:26,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,41843,1678575183185': 2023-03-11 22:54:26,237 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-03-11 22:54:26,237 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-03-11 22:54:26,237 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 22:54:26,238 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 22:54:26,238 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:26,238 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 22:54:26,238 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:26,238 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:26,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:26,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:54:26,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:54:26,238 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:26,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:26,238 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:54:26,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:54:26,239 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:26,239 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:54:26,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:54:26,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:26,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:26,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:54:26,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:26,240 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:26,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:26,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:54:26,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:26,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:26,241 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:26,241 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:54:26,241 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:26,241 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:54:26,241 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-11 22:54:26,241 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 22:54:26,241 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:54:26,241 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-03-11 22:54:26,241 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:54:26,241 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:26,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:54:26,241 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-03-11 22:54:26,241 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:26,241 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 22:54:26,241 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:54:26,241 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:26,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:54:26,241 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:26,242 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:26,342 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 22:54:26,343 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 22:54:26,352 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-11 22:54:26,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-03-11 22:54:26,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:26,354 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-11 22:54:26,354 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:54:26,354 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-03-11 22:54:26,354 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-03-11 22:54:26,355 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:26,355 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:26,355 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:54:26,355 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:26,355 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:54:26,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:54:26,356 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:26,356 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 22:54:26,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:26,356 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:26,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 22:54:26,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:26,356 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:26,357 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-03-11 22:54:26,357 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:26,357 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-03-11 22:54:26,357 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:54:26,357 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-03-11 22:54:26,357 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 22:54:26,357 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 22:54:26,357 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678575258760.db89d2511291454c79f34c24761dad32. 2023-03-11 22:54:26,357 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678575258760.db89d2511291454c79f34c24761dad32. started... 2023-03-11 22:54:26,357 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing db89d2511291454c79f34c24761dad32 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-11 22:54:26,776 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907d10be36b65004cb69fdbed3efa8d9849 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20150907d10be36b65004cb69fdbed3efa8d9849 2023-03-11 22:54:27,185 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32/.tmp/family1/7db3315a0be04ea9803fe4a8e120fc8d 2023-03-11 22:54:27,195 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32/.tmp/family1/7db3315a0be04ea9803fe4a8e120fc8d as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32/family1/7db3315a0be04ea9803fe4a8e120fc8d 2023-03-11 22:54:27,199 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32/family1/7db3315a0be04ea9803fe4a8e120fc8d, entries=1, sequenceid=37, filesize=5.0 K 2023-03-11 22:54:27,200 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for db89d2511291454c79f34c24761dad32 in 843ms, sequenceid=37, compaction requested=true 2023-03-11 22:54:27,200 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for db89d2511291454c79f34c24761dad32: 2023-03-11 22:54:27,200 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678575258760.db89d2511291454c79f34c24761dad32. 2023-03-11 22:54:27,200 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 22:54:27,200 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 22:54:27,200 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:27,200 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-03-11 22:54:27,200 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-03-11 22:54:27,201 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:27,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:27,201 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:27,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:54:27,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:54:27,201 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:27,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:54:27,201 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 22:54:27,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:54:27,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:27,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:27,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:54:27,202 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-03-11 22:54:27,203 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7da453e[Count = 0] remaining members to acquire global barrier 2023-03-11 22:54:27,203 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-03-11 22:54:27,203 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:27,203 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:27,203 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:27,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:27,203 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-03-11 22:54:27,203 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-03-11 22:54:27,203 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,41843,1678575183185' in zk 2023-03-11 22:54:27,204 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:27,204 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 22:54:27,204 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-03-11 22:54:27,204 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:27,204 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:54:27,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:27,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:54:27,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:54:27,204 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-03-11 22:54:27,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:54:27,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:54:27,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:27,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:27,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:54:27,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:27,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:27,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,41843,1678575183185': 2023-03-11 22:54:27,206 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-03-11 22:54:27,206 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-03-11 22:54:27,206 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 22:54:27,206 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 22:54:27,206 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:27,206 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 22:54:27,207 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:27,207 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:27,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:27,207 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:27,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:27,207 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:54:27,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:54:27,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:54:27,207 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:54:27,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:54:27,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:54:27,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:27,207 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:27,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:27,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:54:27,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:27,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:27,208 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:27,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:54:27,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:27,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:27,209 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:27,209 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:54:27,209 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:27,209 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:54:27,209 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:27,209 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:54:27,209 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:54:27,209 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:27,209 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:27,210 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:27,210 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:27,209 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-11 22:54:27,210 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 22:54:27,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:54:27,210 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-03-11 22:54:27,210 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-03-11 22:54:27,210 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:54:27,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:54:27,210 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 22:54:27,310 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 22:54:27,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 22:54:27,314 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-11 22:54:27,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-03-11 22:54:27,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:27,316 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-11 22:54:27,316 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:54:27,316 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-03-11 22:54:27,316 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-03-11 22:54:27,317 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:27,317 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:27,317 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:54:27,318 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:54:27,318 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:27,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:54:27,318 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:27,318 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 22:54:27,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:27,319 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:27,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 22:54:27,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:27,319 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:27,319 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-03-11 22:54:27,319 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:27,319 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-03-11 22:54:27,319 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:54:27,319 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-03-11 22:54:27,320 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 22:54:27,320 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 22:54:27,320 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678575258760.db89d2511291454c79f34c24761dad32. 2023-03-11 22:54:27,320 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678575258760.db89d2511291454c79f34c24761dad32. started... 2023-03-11 22:54:27,320 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing db89d2511291454c79f34c24761dad32 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-11 22:54:27,738 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112075c04c4a04d04732aa51eb3fc333e955 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015112075c04c4a04d04732aa51eb3fc333e955 2023-03-11 22:54:28,145 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32/.tmp/family1/17ef1050413a4c5192c48a784cddd978 2023-03-11 22:54:28,156 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32/.tmp/family1/17ef1050413a4c5192c48a784cddd978 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32/family1/17ef1050413a4c5192c48a784cddd978 2023-03-11 22:54:28,162 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32/family1/17ef1050413a4c5192c48a784cddd978, entries=1, sequenceid=41, filesize=5.0 K 2023-03-11 22:54:28,163 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for db89d2511291454c79f34c24761dad32 in 843ms, sequenceid=41, compaction requested=true 2023-03-11 22:54:28,163 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for db89d2511291454c79f34c24761dad32: 2023-03-11 22:54:28,163 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678575258760.db89d2511291454c79f34c24761dad32. 2023-03-11 22:54:28,163 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 22:54:28,163 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 22:54:28,163 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:28,163 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-03-11 22:54:28,163 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-03-11 22:54:28,165 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:28,165 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:28,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:28,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:54:28,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:54:28,165 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:28,165 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 22:54:28,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:54:28,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:54:28,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:28,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:28,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:54:28,167 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-03-11 22:54:28,167 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-03-11 22:54:28,167 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3a19c78a[Count = 0] remaining members to acquire global barrier 2023-03-11 22:54:28,167 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:28,168 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:28,168 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:28,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:28,168 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-03-11 22:54:28,168 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-03-11 22:54:28,168 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,41843,1678575183185' in zk 2023-03-11 22:54:28,168 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:28,168 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 22:54:28,169 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-03-11 22:54:28,169 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:28,169 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:54:28,169 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-03-11 22:54:28,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:28,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:54:28,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:54:28,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:54:28,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:54:28,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:28,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:28,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:54:28,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:28,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:28,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,41843,1678575183185': 2023-03-11 22:54:28,172 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-03-11 22:54:28,172 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-03-11 22:54:28,172 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 22:54:28,172 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 22:54:28,172 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:28,172 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 22:54:28,173 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:28,174 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:28,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:28,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:54:28,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:54:28,174 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:28,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:28,174 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:54:28,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:54:28,174 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:28,174 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:54:28,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:54:28,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:28,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:28,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:54:28,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:28,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:28,176 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:28,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:54:28,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:28,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:28,178 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:28,178 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:54:28,178 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:28,178 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:54:28,178 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-11 22:54:28,178 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 22:54:28,178 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:54:28,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:54:28,178 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:54:28,178 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:28,179 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-03-11 22:54:28,179 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:28,179 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:54:28,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:54:28,179 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 22:54:28,179 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:28,179 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:28,179 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:28,279 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 22:54:28,281 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 22:54:28,284 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=44347] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:28,287 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] procedure2.ProcedureExecutor(1029): Stored pid=58, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-03-11 22:54:28,288 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=58, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-03-11 22:54:28,289 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-11 22:54:28,289 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=58, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1678575868289 2023-03-11 22:54:28,291 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-11 22:54:28,292 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-03-11 22:54:28,293 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-11 22:54:28,294 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] zookeeper.ReadOnlyZKClient(139): Connect 0x594caab1 to 127.0.0.1:51815 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-11 22:54:28,299 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@11199a6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-11 22:54:28,300 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-11 22:54:29,144 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103c09616e49c5d46dbaf4d22a93cf71b15 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160103c09616e49c5d46dbaf4d22a93cf71b15 2023-03-11 22:54:29,145 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-11 22:54:29,160 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-11 22:54:29,161 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:32964, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-11 22:54:29,168 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-11 22:54:29,169 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:47032, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-11 22:54:29,177 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/42a5f7f942484cc4b683e7541eaa6440 first=Optional[r3] last=Optional[r6] 2023-03-11 22:54:29,177 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678575258760.db89d2511291454c79f34c24761dad32., hostname=jenkins-hbase20.apache.org,41843,1678575183185, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/42a5f7f942484cc4b683e7541eaa6440}] 2023-03-11 22:54:29,182 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/42a5f7f942484cc4b683e7541eaa6440 for inclusion in db89d2511291454c79f34c24761dad32/family1 2023-03-11 22:54:29,185 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-03-11 22:54:29,185 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(777): Region bounds: first= last= 2023-03-11 22:54:29,185 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HRegion(2446): Flush status journal for db89d2511291454c79f34c24761dad32: 2023-03-11 22:54:29,186 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/42a5f7f942484cc4b683e7541eaa6440 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__88lg2ar6hrkdkjtqqf8pufh9l92pektcd03l0om43dj5hlnme59cdhugr0p7b781/family1/42a5f7f942484cc4b683e7541eaa6440 2023-03-11 22:54:29,189 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__88lg2ar6hrkdkjtqqf8pufh9l92pektcd03l0om43dj5hlnme59cdhugr0p7b781/family1/42a5f7f942484cc4b683e7541eaa6440 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32/family1/74407bfeaed547ff9826ecf84a12a7f9_SeqId_44_ 2023-03-11 22:54:29,189 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__88lg2ar6hrkdkjtqqf8pufh9l92pektcd03l0om43dj5hlnme59cdhugr0p7b781/family1/42a5f7f942484cc4b683e7541eaa6440 into db89d2511291454c79f34c24761dad32/family1 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32/family1/74407bfeaed547ff9826ecf84a12a7f9_SeqId_44_ - updating store file list. 2023-03-11 22:54:29,193 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32/family1/74407bfeaed547ff9826ecf84a12a7f9_SeqId_44_ into db89d2511291454c79f34c24761dad32/family1 2023-03-11 22:54:29,193 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__88lg2ar6hrkdkjtqqf8pufh9l92pektcd03l0om43dj5hlnme59cdhugr0p7b781/family1/42a5f7f942484cc4b683e7541eaa6440 into db89d2511291454c79f34c24761dad32/family1 (new location: hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32/family1/74407bfeaed547ff9826ecf84a12a7f9_SeqId_44_) 2023-03-11 22:54:29,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__88lg2ar6hrkdkjtqqf8pufh9l92pektcd03l0om43dj5hlnme59cdhugr0p7b781/family1/42a5f7f942484cc4b683e7541eaa6440 2023-03-11 22:54:29,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-03-11 22:54:29,197 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51552 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-03-11 22:54:29,198 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(1912): db89d2511291454c79f34c24761dad32/family1 is initiating minor compaction 2023-03-11 22:54:29,198 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@5f177cf7; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-11 22:54:29,198 INFO [RS:0;jenkins-hbase20:41843-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of db89d2511291454c79f34c24761dad32/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678575258760.db89d2511291454c79f34c24761dad32. 2023-03-11 22:54:29,198 INFO [RS:0;jenkins-hbase20:41843-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32/family1/853ef8a830ea4bf0b5a65be6e61097a7, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32/family1/616ca27938d34b468509aa15b6ec9341, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32/family1/62dd0da08e2341e4b8d069be4ae839e3, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32/family1/79290cc44ad049d5bd0bd013621aeeb3, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32/family1/1448dc9daffb49d59c71a42a8517f707, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32/family1/5c18248b695144299811c63cdb0cbe52, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32/family1/714f702e7fcb490aab820d9987619b0d, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32/family1/7db3315a0be04ea9803fe4a8e120fc8d, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32/family1/17ef1050413a4c5192c48a784cddd978, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32/family1/74407bfeaed547ff9826ecf84a12a7f9_SeqId_44_] into tmpdir=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32/.tmp, totalSize=50.3 K 2023-03-11 22:54:29,198 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] compactions.Compactor(207): Compacting 853ef8a830ea4bf0b5a65be6e61097a7, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-03-11 22:54:29,198 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] compactions.Compactor(207): Compacting 616ca27938d34b468509aa15b6ec9341, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-03-11 22:54:29,198 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] compactions.Compactor(207): Compacting 62dd0da08e2341e4b8d069be4ae839e3, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-03-11 22:54:29,199 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] compactions.Compactor(207): Compacting 79290cc44ad049d5bd0bd013621aeeb3, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-03-11 22:54:29,199 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] compactions.Compactor(207): Compacting 1448dc9daffb49d59c71a42a8517f707, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-03-11 22:54:29,199 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] compactions.Compactor(207): Compacting 5c18248b695144299811c63cdb0cbe52, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-03-11 22:54:29,199 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] compactions.Compactor(207): Compacting 714f702e7fcb490aab820d9987619b0d, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-03-11 22:54:29,199 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] compactions.Compactor(207): Compacting 7db3315a0be04ea9803fe4a8e120fc8d, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-03-11 22:54:29,199 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] compactions.Compactor(207): Compacting 17ef1050413a4c5192c48a784cddd978, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-03-11 22:54:29,199 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] compactions.Compactor(207): Compacting 74407bfeaed547ff9826ecf84a12a7f9_SeqId_44_, keycount=4, bloomtype=ROW, size=5.6 K, encoding=NONE, compression=NONE, seqNum=45 2023-03-11 22:54:29,200 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-11 22:54:29,201 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 22:54:29,203 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151228970122c09b9045fa8450bd95a9d722dc to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151228970122c09b9045fa8450bd95a9d722dc 2023-03-11 22:54:29,204 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015123129cf7482049a456aaaed5ff223184adf to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015123129cf7482049a456aaaed5ff223184adf 2023-03-11 22:54:29,206 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160101d7b89272c22b4097a700a39d0d9cfca4 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160101d7b89272c22b4097a700a39d0d9cfca4 2023-03-11 22:54:29,207 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160103c76365b7d32e49068e7bfa91857ae128 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160103c76365b7d32e49068e7bfa91857ae128 2023-03-11 22:54:29,207 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 4 expired mob files are deleted 2023-03-11 22:54:29,207 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-03-11 22:54:29,208 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-11 22:54:29,208 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-11 22:54:29,208 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-11 22:54:29,208 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-11 22:54:29,208 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-11 22:54:29,208 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-11 22:54:29,208 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-11 22:54:29,208 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-11 22:54:29,222 INFO [RS:0;jenkins-hbase20:41843-shortCompactions-0] throttle.PressureAwareThroughputController(145): db89d2511291454c79f34c24761dad32#family1#compaction#73 average throughput is 1.58 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-11 22:54:29,597 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x517b638f to 127.0.0.1:51815 2023-03-11 22:54:29,597 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-11 22:54:29,597 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-11 22:54:29,597 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6e9841ec to 127.0.0.1:51815 2023-03-11 22:54:29,597 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-11 22:54:29,597 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-11 22:54:29,597 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5c72f008 to 127.0.0.1:51815 2023-03-11 22:54:29,597 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-11 22:54:29,598 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-11 22:54:29,598 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x185f4f66 to 127.0.0.1:51815 2023-03-11 22:54:29,598 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-11 22:54:30,045 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32/.tmp/family1/f66ae057c4ef489aabb34f1d0707e253 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32/family1/f66ae057c4ef489aabb34f1d0707e253 2023-03-11 22:54:30,045 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512050e0f9d9e305a42b58af148fa4a37ab19 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512050e0f9d9e305a42b58af148fa4a37ab19 2023-03-11 22:54:30,046 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-11 22:54:30,049 INFO [RS:0;jenkins-hbase20:41843-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in db89d2511291454c79f34c24761dad32/family1 of db89d2511291454c79f34c24761dad32 into f66ae057c4ef489aabb34f1d0707e253(size=6.8 K), total size for store is 197.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-11 22:54:30,049 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for db89d2511291454c79f34c24761dad32: 2023-03-11 22:54:30,049 INFO [RS:0;jenkins-hbase20:41843-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678575258760.db89d2511291454c79f34c24761dad32., storeName=family1, fileCount=10, fileSize=50.3 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.6 K), priority=2, time=1678575269198; duration=0sec 2023-03-11 22:54:30,049 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-11 22:54:30,081 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32/family1/853ef8a830ea4bf0b5a65be6e61097a7, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32/family1/616ca27938d34b468509aa15b6ec9341, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32/family1/62dd0da08e2341e4b8d069be4ae839e3, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32/family1/79290cc44ad049d5bd0bd013621aeeb3, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32/family1/1448dc9daffb49d59c71a42a8517f707, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32/family1/5c18248b695144299811c63cdb0cbe52, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32/family1/714f702e7fcb490aab820d9987619b0d, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32/family1/7db3315a0be04ea9803fe4a8e120fc8d, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32/family1/17ef1050413a4c5192c48a784cddd978, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32/family1/74407bfeaed547ff9826ecf84a12a7f9_SeqId_44_] to archive 2023-03-11 22:54:30,082 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 22:54:30,082 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/c815be4eb88947b88cebbd1e4f73fbe1 first=Optional[r00] last=Optional[r2] 2023-03-11 22:54:30,082 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678575258760.db89d2511291454c79f34c24761dad32., hostname=jenkins-hbase20.apache.org,41843,1678575183185, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/c815be4eb88947b88cebbd1e4f73fbe1}] 2023-03-11 22:54:30,084 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32/family1/853ef8a830ea4bf0b5a65be6e61097a7 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32/family1/853ef8a830ea4bf0b5a65be6e61097a7 2023-03-11 22:54:30,084 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/c815be4eb88947b88cebbd1e4f73fbe1 for inclusion in db89d2511291454c79f34c24761dad32/family1 2023-03-11 22:54:30,085 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32/family1/616ca27938d34b468509aa15b6ec9341 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32/family1/616ca27938d34b468509aa15b6ec9341 2023-03-11 22:54:30,086 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32/family1/62dd0da08e2341e4b8d069be4ae839e3 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32/family1/62dd0da08e2341e4b8d069be4ae839e3 2023-03-11 22:54:30,087 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32/family1/79290cc44ad049d5bd0bd013621aeeb3 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32/family1/79290cc44ad049d5bd0bd013621aeeb3 2023-03-11 22:54:30,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-03-11 22:54:30,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(777): Region bounds: first= last= 2023-03-11 22:54:30,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HRegion(2446): Flush status journal for db89d2511291454c79f34c24761dad32: 2023-03-11 22:54:30,088 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32/family1/1448dc9daffb49d59c71a42a8517f707 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32/family1/1448dc9daffb49d59c71a42a8517f707 2023-03-11 22:54:30,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/c815be4eb88947b88cebbd1e4f73fbe1 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__o1spcun2p57kajg2u67155gsnpu2hqvogfu1mmpqu7lc3v6broh67dgbgcc8tpeg/family1/c815be4eb88947b88cebbd1e4f73fbe1 2023-03-11 22:54:30,089 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32/family1/5c18248b695144299811c63cdb0cbe52 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32/family1/5c18248b695144299811c63cdb0cbe52 2023-03-11 22:54:30,091 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32/family1/714f702e7fcb490aab820d9987619b0d to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32/family1/714f702e7fcb490aab820d9987619b0d 2023-03-11 22:54:30,091 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__o1spcun2p57kajg2u67155gsnpu2hqvogfu1mmpqu7lc3v6broh67dgbgcc8tpeg/family1/c815be4eb88947b88cebbd1e4f73fbe1 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32/family1/dea41777f0af45479483a9c1c6ce6190_SeqId_47_ 2023-03-11 22:54:30,091 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__o1spcun2p57kajg2u67155gsnpu2hqvogfu1mmpqu7lc3v6broh67dgbgcc8tpeg/family1/c815be4eb88947b88cebbd1e4f73fbe1 into db89d2511291454c79f34c24761dad32/family1 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32/family1/dea41777f0af45479483a9c1c6ce6190_SeqId_47_ - updating store file list. 2023-03-11 22:54:30,092 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32/family1/7db3315a0be04ea9803fe4a8e120fc8d to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32/family1/7db3315a0be04ea9803fe4a8e120fc8d 2023-03-11 22:54:30,093 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32/family1/17ef1050413a4c5192c48a784cddd978 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32/family1/17ef1050413a4c5192c48a784cddd978 2023-03-11 22:54:30,095 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32/family1/74407bfeaed547ff9826ecf84a12a7f9_SeqId_44_ to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32/family1/74407bfeaed547ff9826ecf84a12a7f9_SeqId_44_ 2023-03-11 22:54:30,095 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32/family1/dea41777f0af45479483a9c1c6ce6190_SeqId_47_ into db89d2511291454c79f34c24761dad32/family1 2023-03-11 22:54:30,096 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__o1spcun2p57kajg2u67155gsnpu2hqvogfu1mmpqu7lc3v6broh67dgbgcc8tpeg/family1/c815be4eb88947b88cebbd1e4f73fbe1 into db89d2511291454c79f34c24761dad32/family1 (new location: hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32/family1/dea41777f0af45479483a9c1c6ce6190_SeqId_47_) 2023-03-11 22:54:30,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__o1spcun2p57kajg2u67155gsnpu2hqvogfu1mmpqu7lc3v6broh67dgbgcc8tpeg/family1/c815be4eb88947b88cebbd1e4f73fbe1 2023-03-11 22:54:30,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-03-11 22:54:30,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 397422 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-03-11 22:54:30,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(1912): db89d2511291454c79f34c24761dad32/family1 is initiating minor compaction (all files) 2023-03-11 22:54:30,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@7e9211a1; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-11 22:54:30,097 INFO [RS:0;jenkins-hbase20:41843-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of db89d2511291454c79f34c24761dad32/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678575258760.db89d2511291454c79f34c24761dad32. 2023-03-11 22:54:30,097 INFO [RS:0;jenkins-hbase20:41843-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32/family1/5dc74fcfbcbb4c0e88c33a1294b30dd9, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32/family1/f66ae057c4ef489aabb34f1d0707e253, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32/family1/dea41777f0af45479483a9c1c6ce6190_SeqId_47_] into tmpdir=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32/.tmp, totalSize=388.1 K 2023-03-11 22:54:30,098 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] compactions.Compactor(207): Compacting 5dc74fcfbcbb4c0e88c33a1294b30dd9, keycount=1000, bloomtype=ROW, size=190.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878807597 2023-03-11 22:54:30,098 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] compactions.Compactor(207): Compacting f66ae057c4ef489aabb34f1d0707e253, keycount=9, bloomtype=ROW, size=6.8 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621207597 2023-03-11 22:54:30,098 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] compactions.Compactor(207): Compacting dea41777f0af45479483a9c1c6ce6190_SeqId_47_, keycount=1002, bloomtype=ROW, size=190.9 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878807597 2023-03-11 22:54:30,099 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-11 22:54:30,100 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 22:54:30,101 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511305b0d9bf432d843c4beea43dd82adb296 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511305b0d9bf432d843c4beea43dd82adb296 2023-03-11 22:54:30,102 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151201f6322c8aa5484718b25ef18385da4210 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151201f6322c8aa5484718b25ef18385da4210 2023-03-11 22:54:30,104 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151205123a34f2fcec421b972ae350d1ef0729 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151205123a34f2fcec421b972ae350d1ef0729 2023-03-11 22:54:30,104 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 3 expired mob files are deleted 2023-03-11 22:54:30,104 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-03-11 22:54:30,105 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-11 22:54:30,105 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-11 22:54:30,105 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-11 22:54:30,106 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=58, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-03-11 22:54:30,107 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=58, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 1.8200 sec 2023-03-11 22:54:30,113 INFO [RS:0;jenkins-hbase20:41843-shortCompactions-0] throttle.PressureAwareThroughputController(145): db89d2511291454c79f34c24761dad32#family1#compaction#74 average throughput is 29.94 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-11 22:54:30,164 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.HMaster$12(2454): Client=jenkins//148.251.75.209 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-03-11 22:54:30,165 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure2.ProcedureExecutor(1029): Stored pid=59, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:30,576 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-03-11 22:54:30,578 DEBUG [PEWorker-5] util.FSTableDescriptors(519): Deleted hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000001 2023-03-11 22:54:30,579 INFO [PEWorker-5] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-03-11 22:54:30,584 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily}] 2023-03-11 22:54:30,587 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=db89d2511291454c79f34c24761dad32, REOPEN/MOVE}] 2023-03-11 22:54:30,588 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=db89d2511291454c79f34c24761dad32, REOPEN/MOVE 2023-03-11 22:54:30,588 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=db89d2511291454c79f34c24761dad32, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:30,589 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678575258760.db89d2511291454c79f34c24761dad32.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1678575270588"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1678575270588"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678575270588"}]},"ts":"1678575270588"} 2023-03-11 22:54:30,590 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=62, ppid=61, state=RUNNABLE; CloseRegionProcedure db89d2511291454c79f34c24761dad32, server=jenkins-hbase20.apache.org,41843,1678575183185}] 2023-03-11 22:54:30,743 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close db89d2511291454c79f34c24761dad32 2023-03-11 22:54:30,743 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing db89d2511291454c79f34c24761dad32, disabling compactions & flushes 2023-03-11 22:54:30,743 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1858): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678575258760.db89d2511291454c79f34c24761dad32. 2023-03-11 22:54:31,349 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32/.tmp/family1/a733d38d88c141e8a78bca045e868c14 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32/family1/a733d38d88c141e8a78bca045e868c14 2023-03-11 22:54:31,355 INFO [RS:0;jenkins-hbase20:41843-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in db89d2511291454c79f34c24761dad32/family1 of db89d2511291454c79f34c24761dad32 into a733d38d88c141e8a78bca045e868c14(size=192.0 K), total size for store is 192.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-11 22:54:31,355 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for db89d2511291454c79f34c24761dad32: 2023-03-11 22:54:31,355 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678575258760.db89d2511291454c79f34c24761dad32. 2023-03-11 22:54:31,356 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678575258760.db89d2511291454c79f34c24761dad32. 2023-03-11 22:54:31,356 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678575258760.db89d2511291454c79f34c24761dad32. after waiting 0 ms 2023-03-11 22:54:31,356 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678575258760.db89d2511291454c79f34c24761dad32. 2023-03-11 22:54:31,356 INFO [RS:0;jenkins-hbase20:41843-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678575258760.db89d2511291454c79f34c24761dad32., storeName=family1, fileCount=3, fileSize=388.1 K (190.5 K, 6.8 K, 190.9 K), priority=2, time=1678575270097; duration=1sec 2023-03-11 22:54:31,356 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-11 22:54:31,360 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678575258760.db89d2511291454c79f34c24761dad32.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32/family1/5dc74fcfbcbb4c0e88c33a1294b30dd9, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32/family1/f66ae057c4ef489aabb34f1d0707e253, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32/family1/dea41777f0af45479483a9c1c6ce6190_SeqId_47_] to archive 2023-03-11 22:54:31,361 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678575258760.db89d2511291454c79f34c24761dad32.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 22:54:31,364 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678575258760.db89d2511291454c79f34c24761dad32.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32/family1/5dc74fcfbcbb4c0e88c33a1294b30dd9 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32/family1/5dc74fcfbcbb4c0e88c33a1294b30dd9 2023-03-11 22:54:31,365 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678575258760.db89d2511291454c79f34c24761dad32.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32/family1/f66ae057c4ef489aabb34f1d0707e253 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32/family1/f66ae057c4ef489aabb34f1d0707e253 2023-03-11 22:54:31,367 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678575258760.db89d2511291454c79f34c24761dad32.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32/family1/dea41777f0af45479483a9c1c6ce6190_SeqId_47_ to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32/family1/dea41777f0af45479483a9c1c6ce6190_SeqId_47_ 2023-03-11 22:54:31,372 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-03-11 22:54:31,374 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678575258760.db89d2511291454c79f34c24761dad32. 2023-03-11 22:54:31,374 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for db89d2511291454c79f34c24761dad32: 2023-03-11 22:54:31,374 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(3509): Not adding moved region record: db89d2511291454c79f34c24761dad32 to self. 2023-03-11 22:54:31,375 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed db89d2511291454c79f34c24761dad32 2023-03-11 22:54:31,376 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=db89d2511291454c79f34c24761dad32, regionState=CLOSED 2023-03-11 22:54:31,376 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678575258760.db89d2511291454c79f34c24761dad32.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1678575271376"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678575271376"}]},"ts":"1678575271376"} 2023-03-11 22:54:31,379 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=62, resume processing ppid=61 2023-03-11 22:54:31,379 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=62, ppid=61, state=SUCCESS; CloseRegionProcedure db89d2511291454c79f34c24761dad32, server=jenkins-hbase20.apache.org,41843,1678575183185 in 787 msec 2023-03-11 22:54:31,380 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=db89d2511291454c79f34c24761dad32, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase20.apache.org,41843,1678575183185; forceNewPlan=false, retain=true 2023-03-11 22:54:31,530 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=db89d2511291454c79f34c24761dad32, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:31,530 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678575258760.db89d2511291454c79f34c24761dad32.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1678575271530"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1678575271530"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678575271530"}]},"ts":"1678575271530"} 2023-03-11 22:54:31,532 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=63, ppid=61, state=RUNNABLE; OpenRegionProcedure db89d2511291454c79f34c24761dad32, server=jenkins-hbase20.apache.org,41843,1678575183185}] 2023-03-11 22:54:31,688 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678575258760.db89d2511291454c79f34c24761dad32. 2023-03-11 22:54:31,688 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => db89d2511291454c79f34c24761dad32, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678575258760.db89d2511291454c79f34c24761dad32.', STARTKEY => '', ENDKEY => ''} 2023-03-11 22:54:31,689 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily db89d2511291454c79f34c24761dad32 2023-03-11 22:54:31,689 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678575258760.db89d2511291454c79f34c24761dad32.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-11 22:54:31,689 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for db89d2511291454c79f34c24761dad32 2023-03-11 22:54:31,689 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for db89d2511291454c79f34c24761dad32 2023-03-11 22:54:31,691 INFO [StoreOpener-db89d2511291454c79f34c24761dad32-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region db89d2511291454c79f34c24761dad32 2023-03-11 22:54:31,693 DEBUG [StoreOpener-db89d2511291454c79f34c24761dad32-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32/family1 2023-03-11 22:54:31,693 DEBUG [StoreOpener-db89d2511291454c79f34c24761dad32-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32/family1 2023-03-11 22:54:31,693 INFO [StoreOpener-db89d2511291454c79f34c24761dad32-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region db89d2511291454c79f34c24761dad32 columnFamilyName family1 2023-03-11 22:54:31,704 DEBUG [StoreOpener-db89d2511291454c79f34c24761dad32-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32/family1/a733d38d88c141e8a78bca045e868c14 2023-03-11 22:54:31,704 INFO [StoreOpener-db89d2511291454c79f34c24761dad32-1] regionserver.HStore(310): Store=db89d2511291454c79f34c24761dad32/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-11 22:54:31,706 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32 2023-03-11 22:54:31,708 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32 2023-03-11 22:54:31,711 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for db89d2511291454c79f34c24761dad32 2023-03-11 22:54:31,713 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened db89d2511291454c79f34c24761dad32; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73836701, jitterRate=0.10025258362293243}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-11 22:54:31,713 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for db89d2511291454c79f34c24761dad32: 2023-03-11 22:54:31,713 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678575258760.db89d2511291454c79f34c24761dad32., pid=63, masterSystemTime=1678575271684 2023-03-11 22:54:31,715 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678575258760.db89d2511291454c79f34c24761dad32. 2023-03-11 22:54:31,715 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678575258760.db89d2511291454c79f34c24761dad32. 2023-03-11 22:54:31,715 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=db89d2511291454c79f34c24761dad32, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:31,715 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678575258760.db89d2511291454c79f34c24761dad32.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1678575271715"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1678575271715"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678575271715"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678575271715"}]},"ts":"1678575271715"} 2023-03-11 22:54:31,719 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=63, resume processing ppid=61 2023-03-11 22:54:31,719 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=63, ppid=61, state=SUCCESS; OpenRegionProcedure db89d2511291454c79f34c24761dad32, server=jenkins-hbase20.apache.org,41843,1678575183185 in 185 msec 2023-03-11 22:54:31,721 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=60 2023-03-11 22:54:31,721 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=60, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=db89d2511291454c79f34c24761dad32, REOPEN/MOVE in 1.1320 sec 2023-03-11 22:54:31,724 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=59 2023-03-11 22:54:31,724 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=59, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.1380 sec 2023-03-11 22:54:31,726 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=59, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.5610 sec 2023-03-11 22:54:31,727 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1227): Checking to see if procedure is done pid=59 2023-03-11 22:54:31,729 INFO [Listener at localhost.localdomain/41563] compactions.TestMobCompactor(278): alter status finished 2023-03-11 22:54:31,730 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=44347] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:31,732 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-03-11 22:54:31,733 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-03-11 22:54:31,734 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-11 22:54:31,734 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1678575871734 2023-03-11 22:54:31,734 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-11 22:54:31,735 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-03-11 22:54:31,735 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-11 22:54:31,735 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] zookeeper.ReadOnlyZKClient(139): Connect 0x5c92e484 to 127.0.0.1:51815 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-11 22:54:31,925 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3a6b0729, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-11 22:54:31,925 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-11 22:54:31,926 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-11 22:54:31,926 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-11 22:54:31,926 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-11 22:54:31,926 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-11 22:54:32,767 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128275c575bea2c4d24be6af0ec904be2db to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151128275c575bea2c4d24be6af0ec904be2db 2023-03-11 22:54:32,769 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-11 22:54:32,787 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-11 22:54:32,788 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:46804, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-11 22:54:32,793 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-11 22:54:32,795 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:52362, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-11 22:54:32,803 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/33ad6db646224e8597ab722ed30f845a first=Optional[r05] last=Optional[r8] 2023-03-11 22:54:32,804 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678575258760.db89d2511291454c79f34c24761dad32., hostname=jenkins-hbase20.apache.org,41843,1678575183185, seqNum=51 for row with hfile group [{family1,hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/33ad6db646224e8597ab722ed30f845a}] 2023-03-11 22:54:32,809 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/33ad6db646224e8597ab722ed30f845a for inclusion in db89d2511291454c79f34c24761dad32/family1 2023-03-11 22:54:32,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-03-11 22:54:32,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(777): Region bounds: first= last= 2023-03-11 22:54:32,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HRegion(2446): Flush status journal for db89d2511291454c79f34c24761dad32: 2023-03-11 22:54:32,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/33ad6db646224e8597ab722ed30f845a to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__v3797esb21247a8ig65lekmpa4lk80jmtim4eoa6idfed89b521qj1r4h0oqng8v/family1/33ad6db646224e8597ab722ed30f845a 2023-03-11 22:54:32,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__v3797esb21247a8ig65lekmpa4lk80jmtim4eoa6idfed89b521qj1r4h0oqng8v/family1/33ad6db646224e8597ab722ed30f845a as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32/family1/d962361d10a34fad9abb42e9575875ac_SeqId_53_ 2023-03-11 22:54:32,816 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__v3797esb21247a8ig65lekmpa4lk80jmtim4eoa6idfed89b521qj1r4h0oqng8v/family1/33ad6db646224e8597ab722ed30f845a into db89d2511291454c79f34c24761dad32/family1 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32/family1/d962361d10a34fad9abb42e9575875ac_SeqId_53_ - updating store file list. 2023-03-11 22:54:32,820 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32/family1/d962361d10a34fad9abb42e9575875ac_SeqId_53_ into db89d2511291454c79f34c24761dad32/family1 2023-03-11 22:54:32,820 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__v3797esb21247a8ig65lekmpa4lk80jmtim4eoa6idfed89b521qj1r4h0oqng8v/family1/33ad6db646224e8597ab722ed30f845a into db89d2511291454c79f34c24761dad32/family1 (new location: hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32/family1/d962361d10a34fad9abb42e9575875ac_SeqId_53_) 2023-03-11 22:54:32,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__v3797esb21247a8ig65lekmpa4lk80jmtim4eoa6idfed89b521qj1r4h0oqng8v/family1/33ad6db646224e8597ab722ed30f845a 2023-03-11 22:54:32,822 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-11 22:54:32,823 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 22:54:32,824 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015112075c04c4a04d04732aa51eb3fc333e955 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015112075c04c4a04d04732aa51eb3fc333e955 2023-03-11 22:54:32,825 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015112847bd931e052045799f4b208d5a9f703b to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015112847bd931e052045799f4b208d5a9f703b 2023-03-11 22:54:32,825 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2 expired mob files are deleted 2023-03-11 22:54:32,825 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-03-11 22:54:32,826 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-11 22:54:32,826 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-11 22:54:32,826 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-11 22:54:32,826 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-11 22:54:32,826 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-11 22:54:32,828 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-03-11 22:54:32,829 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 1.0970 sec 2023-03-11 22:54:32,886 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.HMaster$12(2454): Client=jenkins//148.251.75.209 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'} 2023-03-11 22:54:32,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:33,297 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000003 2023-03-11 22:54:33,300 DEBUG [PEWorker-1] util.FSTableDescriptors(519): Deleted hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-03-11 22:54:33,301 INFO [PEWorker-1] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000003 2023-03-11 22:54:33,305 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=66, ppid=65, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily}] 2023-03-11 22:54:33,308 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=db89d2511291454c79f34c24761dad32, REOPEN/MOVE}] 2023-03-11 22:54:33,309 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=db89d2511291454c79f34c24761dad32, REOPEN/MOVE 2023-03-11 22:54:33,309 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=db89d2511291454c79f34c24761dad32, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:33,309 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678575258760.db89d2511291454c79f34c24761dad32.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1678575273309"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1678575273309"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678575273309"}]},"ts":"1678575273309"} 2023-03-11 22:54:33,311 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=68, ppid=67, state=RUNNABLE; CloseRegionProcedure db89d2511291454c79f34c24761dad32, server=jenkins-hbase20.apache.org,41843,1678575183185}] 2023-03-11 22:54:33,463 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close db89d2511291454c79f34c24761dad32 2023-03-11 22:54:33,464 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing db89d2511291454c79f34c24761dad32, disabling compactions & flushes 2023-03-11 22:54:33,464 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678575258760.db89d2511291454c79f34c24761dad32. 2023-03-11 22:54:33,464 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678575258760.db89d2511291454c79f34c24761dad32. 2023-03-11 22:54:33,464 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678575258760.db89d2511291454c79f34c24761dad32. after waiting 0 ms 2023-03-11 22:54:33,464 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678575258760.db89d2511291454c79f34c24761dad32. 2023-03-11 22:54:33,475 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-03-11 22:54:33,476 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678575258760.db89d2511291454c79f34c24761dad32. 2023-03-11 22:54:33,476 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for db89d2511291454c79f34c24761dad32: 2023-03-11 22:54:33,476 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(3509): Not adding moved region record: db89d2511291454c79f34c24761dad32 to self. 2023-03-11 22:54:33,477 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed db89d2511291454c79f34c24761dad32 2023-03-11 22:54:33,477 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=db89d2511291454c79f34c24761dad32, regionState=CLOSED 2023-03-11 22:54:33,478 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678575258760.db89d2511291454c79f34c24761dad32.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1678575273477"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678575273477"}]},"ts":"1678575273477"} 2023-03-11 22:54:33,480 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=68, resume processing ppid=67 2023-03-11 22:54:33,480 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=67, state=SUCCESS; CloseRegionProcedure db89d2511291454c79f34c24761dad32, server=jenkins-hbase20.apache.org,41843,1678575183185 in 168 msec 2023-03-11 22:54:33,481 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=db89d2511291454c79f34c24761dad32, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase20.apache.org,41843,1678575183185; forceNewPlan=false, retain=true 2023-03-11 22:54:33,631 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=db89d2511291454c79f34c24761dad32, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:33,631 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678575258760.db89d2511291454c79f34c24761dad32.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1678575273631"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1678575273631"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678575273631"}]},"ts":"1678575273631"} 2023-03-11 22:54:33,633 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure db89d2511291454c79f34c24761dad32, server=jenkins-hbase20.apache.org,41843,1678575183185}] 2023-03-11 22:54:33,787 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678575258760.db89d2511291454c79f34c24761dad32. 2023-03-11 22:54:33,787 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => db89d2511291454c79f34c24761dad32, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678575258760.db89d2511291454c79f34c24761dad32.', STARTKEY => '', ENDKEY => ''} 2023-03-11 22:54:33,788 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily db89d2511291454c79f34c24761dad32 2023-03-11 22:54:33,788 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678575258760.db89d2511291454c79f34c24761dad32.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-11 22:54:33,788 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for db89d2511291454c79f34c24761dad32 2023-03-11 22:54:33,788 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for db89d2511291454c79f34c24761dad32 2023-03-11 22:54:33,789 INFO [StoreOpener-db89d2511291454c79f34c24761dad32-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region db89d2511291454c79f34c24761dad32 2023-03-11 22:54:33,790 DEBUG [StoreOpener-db89d2511291454c79f34c24761dad32-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32/family1 2023-03-11 22:54:33,790 DEBUG [StoreOpener-db89d2511291454c79f34c24761dad32-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32/family1 2023-03-11 22:54:33,791 INFO [StoreOpener-db89d2511291454c79f34c24761dad32-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region db89d2511291454c79f34c24761dad32 columnFamilyName family1 2023-03-11 22:54:33,800 DEBUG [StoreOpener-db89d2511291454c79f34c24761dad32-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32/family1/a733d38d88c141e8a78bca045e868c14 2023-03-11 22:54:33,806 DEBUG [StoreOpener-db89d2511291454c79f34c24761dad32-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32/family1/d962361d10a34fad9abb42e9575875ac_SeqId_53_ 2023-03-11 22:54:33,806 INFO [StoreOpener-db89d2511291454c79f34c24761dad32-1] regionserver.HStore(310): Store=db89d2511291454c79f34c24761dad32/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-11 22:54:33,808 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32 2023-03-11 22:54:33,810 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32 2023-03-11 22:54:33,814 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for db89d2511291454c79f34c24761dad32 2023-03-11 22:54:33,815 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened db89d2511291454c79f34c24761dad32; next sequenceid=56; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71422298, jitterRate=0.06427517533302307}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-11 22:54:33,815 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for db89d2511291454c79f34c24761dad32: 2023-03-11 22:54:33,816 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678575258760.db89d2511291454c79f34c24761dad32., pid=69, masterSystemTime=1678575273784 2023-03-11 22:54:33,818 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678575258760.db89d2511291454c79f34c24761dad32. 2023-03-11 22:54:33,818 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678575258760.db89d2511291454c79f34c24761dad32. 2023-03-11 22:54:33,818 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=db89d2511291454c79f34c24761dad32, regionState=OPEN, openSeqNum=56, regionLocation=jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:33,818 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678575258760.db89d2511291454c79f34c24761dad32.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1678575273818"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1678575273818"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678575273818"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678575273818"}]},"ts":"1678575273818"} 2023-03-11 22:54:33,821 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=67 2023-03-11 22:54:33,822 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure db89d2511291454c79f34c24761dad32, server=jenkins-hbase20.apache.org,41843,1678575183185 in 187 msec 2023-03-11 22:54:33,823 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=67, resume processing ppid=66 2023-03-11 22:54:33,823 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=db89d2511291454c79f34c24761dad32, REOPEN/MOVE in 514 msec 2023-03-11 22:54:33,824 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=66, resume processing ppid=65 2023-03-11 22:54:33,824 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=66, ppid=65, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 518 msec 2023-03-11 22:54:33,826 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 939 msec 2023-03-11 22:54:33,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1227): Checking to see if procedure is done pid=65 2023-03-11 22:54:33,827 INFO [Listener at localhost.localdomain/41563] compactions.TestMobCompactor(278): alter status finished 2023-03-11 22:54:33,828 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=44347] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-11 22:54:33,830 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] procedure2.ProcedureExecutor(1029): Stored pid=70, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-03-11 22:54:33,830 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=70, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-03-11 22:54:33,831 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-11 22:54:33,831 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=70, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1678575873831 2023-03-11 22:54:33,834 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-11 22:54:33,834 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 4 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-03-11 22:54:33,835 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-11 22:54:33,835 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] zookeeper.ReadOnlyZKClient(139): Connect 0x370570d0 to 127.0.0.1:51815 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-11 22:54:33,839 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2022343f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-11 22:54:33,839 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151128 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-11 22:54:33,839 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151128 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-11 22:54:33,839 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151205 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-11 22:54:33,839 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151205 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-11 22:54:33,839 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160103 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-11 22:54:33,839 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160103 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-11 22:54:33,839 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-11 22:54:33,839 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-11 22:54:33,839 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-11 22:54:33,839 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-11 22:54:33,840 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=70, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-03-11 22:54:33,841 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=70, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 11 msec 2023-03-11 22:54:33,882 INFO [Listener at localhost.localdomain/41563] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily Thread=239 (was 243), OpenFileDescriptor=613 (was 617), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=246 (was 252), ProcessCount=168 (was 168), AvailableMemoryMB=21560 (was 21549) - AvailableMemoryMB LEAK? - 2023-03-11 22:54:33,891 INFO [Listener at localhost.localdomain/41563] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testGetAfterCompaction Thread=239, OpenFileDescriptor=613, MaxFileDescriptor=60000, SystemLoadAverage=246, ProcessCount=168, AvailableMemoryMB=21559 2023-03-11 22:54:33,895 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testGetAfterCompaction', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro|1073741823|'}}, {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-03-11 22:54:33,896 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testGetAfterCompaction 2023-03-11 22:54:33,897 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_PRE_OPERATION 2023-03-11 22:54:33,897 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(697): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testGetAfterCompaction" procId is: 71 2023-03-11 22:54:33,898 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-11 22:54:33,898 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-03-11 22:54:33,899 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/.tmp/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4 2023-03-11 22:54:33,899 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/.tmp/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4 empty. 2023-03-11 22:54:33,899 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/.tmp/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4 2023-03-11 22:54:33,899 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testGetAfterCompaction regions 2023-03-11 22:54:33,999 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-03-11 22:54:34,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-03-11 22:54:34,308 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/.tmp/data/default/testGetAfterCompaction/.tabledesc/.tableinfo.0000000001 2023-03-11 22:54:34,309 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(7675): creating {ENCODED => 257685b4306531b32961d1c4912a3ad4, NAME => 'testGetAfterCompaction,,1678575273895.257685b4306531b32961d1c4912a3ad4.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testGetAfterCompaction', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro|1073741823|'}}, {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/.tmp 2023-03-11 22:54:34,501 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-03-11 22:54:34,715 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(866): Instantiated testGetAfterCompaction,,1678575273895.257685b4306531b32961d1c4912a3ad4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-11 22:54:34,715 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1604): Closing 257685b4306531b32961d1c4912a3ad4, disabling compactions & flushes 2023-03-11 22:54:34,715 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1626): Closing region testGetAfterCompaction,,1678575273895.257685b4306531b32961d1c4912a3ad4. 2023-03-11 22:54:34,716 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testGetAfterCompaction,,1678575273895.257685b4306531b32961d1c4912a3ad4. 2023-03-11 22:54:34,716 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1714): Acquired close lock on testGetAfterCompaction,,1678575273895.257685b4306531b32961d1c4912a3ad4. after waiting 0 ms 2023-03-11 22:54:34,716 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1724): Updates disabled for region testGetAfterCompaction,,1678575273895.257685b4306531b32961d1c4912a3ad4. 2023-03-11 22:54:34,716 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1838): Closed testGetAfterCompaction,,1678575273895.257685b4306531b32961d1c4912a3ad4. 2023-03-11 22:54:34,716 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1558): Region close journal for 257685b4306531b32961d1c4912a3ad4: 2023-03-11 22:54:34,720 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_ADD_TO_META 2023-03-11 22:54:34,722 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testGetAfterCompaction,,1678575273895.257685b4306531b32961d1c4912a3ad4.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1678575274722"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678575274722"}]},"ts":"1678575274722"} 2023-03-11 22:54:34,724 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-03-11 22:54:34,726 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-11 22:54:34,726 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678575274726"}]},"ts":"1678575274726"} 2023-03-11 22:54:34,727 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=ENABLING in hbase:meta 2023-03-11 22:54:34,729 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testGetAfterCompaction, region=257685b4306531b32961d1c4912a3ad4, ASSIGN}] 2023-03-11 22:54:34,731 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testGetAfterCompaction, region=257685b4306531b32961d1c4912a3ad4, ASSIGN 2023-03-11 22:54:34,731 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testGetAfterCompaction, region=257685b4306531b32961d1c4912a3ad4, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,41843,1678575183185; forceNewPlan=false, retain=false 2023-03-11 22:54:34,883 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=257685b4306531b32961d1c4912a3ad4, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:34,883 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testGetAfterCompaction,,1678575273895.257685b4306531b32961d1c4912a3ad4.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1678575274883"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1678575274883"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678575274883"}]},"ts":"1678575274883"} 2023-03-11 22:54:34,885 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=73, ppid=72, state=RUNNABLE; OpenRegionProcedure 257685b4306531b32961d1c4912a3ad4, server=jenkins-hbase20.apache.org,41843,1678575183185}] 2023-03-11 22:54:35,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-03-11 22:54:35,043 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testGetAfterCompaction,,1678575273895.257685b4306531b32961d1c4912a3ad4. 2023-03-11 22:54:35,044 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 257685b4306531b32961d1c4912a3ad4, NAME => 'testGetAfterCompaction,,1678575273895.257685b4306531b32961d1c4912a3ad4.', STARTKEY => '', ENDKEY => ''} 2023-03-11 22:54:35,044 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro with path null and priority 1073741823 2023-03-11 22:54:35,046 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro from HTD of testGetAfterCompaction successfully. 2023-03-11 22:54:35,047 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testGetAfterCompaction 257685b4306531b32961d1c4912a3ad4 2023-03-11 22:54:35,047 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testGetAfterCompaction,,1678575273895.257685b4306531b32961d1c4912a3ad4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-11 22:54:35,047 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 257685b4306531b32961d1c4912a3ad4 2023-03-11 22:54:35,047 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 257685b4306531b32961d1c4912a3ad4 2023-03-11 22:54:35,049 INFO [StoreOpener-257685b4306531b32961d1c4912a3ad4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 257685b4306531b32961d1c4912a3ad4 2023-03-11 22:54:35,051 DEBUG [StoreOpener-257685b4306531b32961d1c4912a3ad4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4/f1 2023-03-11 22:54:35,051 DEBUG [StoreOpener-257685b4306531b32961d1c4912a3ad4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4/f1 2023-03-11 22:54:35,051 INFO [StoreOpener-257685b4306531b32961d1c4912a3ad4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 257685b4306531b32961d1c4912a3ad4 columnFamilyName f1 2023-03-11 22:54:35,053 INFO [StoreOpener-257685b4306531b32961d1c4912a3ad4-1] regionserver.HStore(310): Store=257685b4306531b32961d1c4912a3ad4/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-11 22:54:35,054 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4 2023-03-11 22:54:35,054 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4 2023-03-11 22:54:35,056 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 257685b4306531b32961d1c4912a3ad4 2023-03-11 22:54:35,057 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-11 22:54:35,058 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 257685b4306531b32961d1c4912a3ad4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62504985, jitterRate=-0.06860314309597015}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-11 22:54:35,058 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 257685b4306531b32961d1c4912a3ad4: 2023-03-11 22:54:35,058 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testGetAfterCompaction,,1678575273895.257685b4306531b32961d1c4912a3ad4., pid=73, masterSystemTime=1678575275037 2023-03-11 22:54:35,060 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testGetAfterCompaction,,1678575273895.257685b4306531b32961d1c4912a3ad4. 2023-03-11 22:54:35,060 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testGetAfterCompaction,,1678575273895.257685b4306531b32961d1c4912a3ad4. 2023-03-11 22:54:35,060 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=257685b4306531b32961d1c4912a3ad4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:35,060 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testGetAfterCompaction,,1678575273895.257685b4306531b32961d1c4912a3ad4.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1678575275060"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1678575275060"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678575275060"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678575275060"}]},"ts":"1678575275060"} 2023-03-11 22:54:35,062 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=73, resume processing ppid=72 2023-03-11 22:54:35,062 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=72, state=SUCCESS; OpenRegionProcedure 257685b4306531b32961d1c4912a3ad4, server=jenkins-hbase20.apache.org,41843,1678575183185 in 176 msec 2023-03-11 22:54:35,063 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=72, resume processing ppid=71 2023-03-11 22:54:35,063 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testGetAfterCompaction, region=257685b4306531b32961d1c4912a3ad4, ASSIGN in 333 msec 2023-03-11 22:54:35,064 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-11 22:54:35,064 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678575275064"}]},"ts":"1678575275064"} 2023-03-11 22:54:35,065 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=ENABLED in hbase:meta 2023-03-11 22:54:35,067 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_POST_OPERATION 2023-03-11 22:54:35,067 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; CreateTableProcedure table=testGetAfterCompaction in 1.1720 sec 2023-03-11 22:54:36,005 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-03-11 22:54:36,005 INFO [Listener at localhost.localdomain/41563] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testGetAfterCompaction, procId: 71 completed 2023-03-11 22:54:36,005 DEBUG [Listener at localhost.localdomain/41563] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testGetAfterCompaction get assigned. Timeout = 60000ms 2023-03-11 22:54:36,009 INFO [Listener at localhost.localdomain/41563] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-03-11 22:54:36,014 INFO [Listener at localhost.localdomain/41563] hbase.HBaseTestingUtility(3484): All regions for table testGetAfterCompaction assigned to meta. Checking AM states. 2023-03-11 22:54:36,015 INFO [Listener at localhost.localdomain/41563] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-03-11 22:54:36,015 INFO [Listener at localhost.localdomain/41563] hbase.HBaseTestingUtility(3504): All regions for table testGetAfterCompaction assigned. 2023-03-11 22:54:36,020 INFO [Listener at localhost.localdomain/41563] regionserver.HRegion(2745): Flushing 257685b4306531b32961d1c4912a3ad4 1/1 column families, dataSize=37 B heapSize=368 B 2023-03-11 22:54:36,433 INFO [Listener at localhost.localdomain/41563] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023031164da6883033b4617aba158501b707a97 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023031164da6883033b4617aba158501b707a97 2023-03-11 22:54:36,838 INFO [Listener at localhost.localdomain/41563] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=37, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4/.tmp/f1/c3db4262a2674eaea6282be11a61f41f 2023-03-11 22:54:36,842 DEBUG [Listener at localhost.localdomain/41563] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4/.tmp/f1/c3db4262a2674eaea6282be11a61f41f as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4/f1/c3db4262a2674eaea6282be11a61f41f 2023-03-11 22:54:36,847 INFO [Listener at localhost.localdomain/41563] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4/f1/c3db4262a2674eaea6282be11a61f41f, entries=1, sequenceid=5, filesize=4.9 K 2023-03-11 22:54:36,848 INFO [Listener at localhost.localdomain/41563] regionserver.HRegion(2948): Finished flush of dataSize ~37 B/37, heapSize ~352 B/352, currentSize=0 B/0 for 257685b4306531b32961d1c4912a3ad4 in 828ms, sequenceid=5, compaction requested=false 2023-03-11 22:54:36,848 DEBUG [Listener at localhost.localdomain/41563] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testGetAfterCompaction' 2023-03-11 22:54:36,848 DEBUG [Listener at localhost.localdomain/41563] regionserver.HRegion(2446): Flush status journal for 257685b4306531b32961d1c4912a3ad4: 2023-03-11 22:54:36,850 INFO [Listener at localhost.localdomain/41563] regionserver.HRegion(2745): Flushing 257685b4306531b32961d1c4912a3ad4 1/1 column families, dataSize=37 B heapSize=368 B 2023-03-11 22:54:36,908 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-11 22:54:37,270 INFO [Listener at localhost.localdomain/41563] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303119be6c0fd3c47468ab524808a0a125420 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202303119be6c0fd3c47468ab524808a0a125420 2023-03-11 22:54:37,678 INFO [Listener at localhost.localdomain/41563] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=37, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4/.tmp/f1/e2550728673445b38d7125048b0f558d 2023-03-11 22:54:37,688 DEBUG [Listener at localhost.localdomain/41563] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4/.tmp/f1/e2550728673445b38d7125048b0f558d as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4/f1/e2550728673445b38d7125048b0f558d 2023-03-11 22:54:37,696 INFO [Listener at localhost.localdomain/41563] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4/f1/e2550728673445b38d7125048b0f558d, entries=1, sequenceid=9, filesize=4.9 K 2023-03-11 22:54:37,697 INFO [Listener at localhost.localdomain/41563] regionserver.HRegion(2948): Finished flush of dataSize ~37 B/37, heapSize ~352 B/352, currentSize=0 B/0 for 257685b4306531b32961d1c4912a3ad4 in 847ms, sequenceid=9, compaction requested=false 2023-03-11 22:54:37,697 DEBUG [Listener at localhost.localdomain/41563] regionserver.HRegion(2446): Flush status journal for 257685b4306531b32961d1c4912a3ad4: 2023-03-11 22:54:37,699 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=44347] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testGetAfterCompaction 2023-03-11 22:54:37,701 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] procedure2.ProcedureExecutor(1029): Stored pid=74, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-03-11 22:54:37,702 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=74, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-03-11 22:54:37,702 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] mob.MobUtils(833): start MOB compaction of files for table='testGetAfterCompaction', column='f1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-11 22:54:37,702 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=74, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1678575877702 2023-03-11 22:54:37,703 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-03-11 22:54:37,703 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 2 selected files, and 0 irrelevant files table 'testGetAfterCompaction' and column 'f1' 2023-03-11 22:54:37,703 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testGetAfterCompaction' column='f1' 2023-03-11 22:54:37,704 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] zookeeper.ReadOnlyZKClient(139): Connect 0x5e66fa64 to 127.0.0.1:51815 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-11 22:54:37,707 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6f54be5b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-11 22:54:37,708 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230311 for table='testGetAfterCompaction' and column='f1' 2023-03-11 22:54:37,751 INFO [Listener at localhost.localdomain/41563] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4/f1/c3db4262a2674eaea6282be11a61f41f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678575276838; access_time=1678575276023; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 22:54:37,752 INFO [Listener at localhost.localdomain/41563] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4/f1/e2550728673445b38d7125048b0f558d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678575277677; access_time=1678575276852; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 22:54:37,803 INFO [Listener at localhost.localdomain/41563] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4/f1/c3db4262a2674eaea6282be11a61f41f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678575276838; access_time=1678575276023; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 22:54:37,803 INFO [Listener at localhost.localdomain/41563] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4/f1/e2550728673445b38d7125048b0f558d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678575277677; access_time=1678575276852; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 22:54:37,854 INFO [Listener at localhost.localdomain/41563] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4/f1/c3db4262a2674eaea6282be11a61f41f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678575276838; access_time=1678575276023; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 22:54:37,854 INFO [Listener at localhost.localdomain/41563] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4/f1/e2550728673445b38d7125048b0f558d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678575277677; access_time=1678575276852; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 22:54:37,905 INFO [Listener at localhost.localdomain/41563] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4/f1/c3db4262a2674eaea6282be11a61f41f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678575276838; access_time=1678575276023; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 22:54:37,906 INFO [Listener at localhost.localdomain/41563] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4/f1/e2550728673445b38d7125048b0f558d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678575277677; access_time=1678575276852; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 22:54:37,957 INFO [Listener at localhost.localdomain/41563] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4/f1/c3db4262a2674eaea6282be11a61f41f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678575276838; access_time=1678575276023; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 22:54:37,957 INFO [Listener at localhost.localdomain/41563] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4/f1/e2550728673445b38d7125048b0f558d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678575277677; access_time=1678575276852; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 22:54:38,009 INFO [Listener at localhost.localdomain/41563] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4/f1/c3db4262a2674eaea6282be11a61f41f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678575276838; access_time=1678575276023; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 22:54:38,009 INFO [Listener at localhost.localdomain/41563] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4/f1/e2550728673445b38d7125048b0f558d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678575277677; access_time=1678575276852; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 22:54:38,060 INFO [Listener at localhost.localdomain/41563] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4/f1/c3db4262a2674eaea6282be11a61f41f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678575276838; access_time=1678575276023; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 22:54:38,060 INFO [Listener at localhost.localdomain/41563] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4/f1/e2550728673445b38d7125048b0f558d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678575277677; access_time=1678575276852; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 22:54:38,112 INFO [Listener at localhost.localdomain/41563] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4/f1/c3db4262a2674eaea6282be11a61f41f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678575276838; access_time=1678575276023; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 22:54:38,112 INFO [Listener at localhost.localdomain/41563] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4/f1/e2550728673445b38d7125048b0f558d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678575277677; access_time=1678575276852; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 22:54:38,163 INFO [Listener at localhost.localdomain/41563] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4/f1/c3db4262a2674eaea6282be11a61f41f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678575276838; access_time=1678575276023; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 22:54:38,164 INFO [Listener at localhost.localdomain/41563] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4/f1/e2550728673445b38d7125048b0f558d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678575277677; access_time=1678575276852; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 22:54:38,215 INFO [Listener at localhost.localdomain/41563] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4/f1/c3db4262a2674eaea6282be11a61f41f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678575276838; access_time=1678575276023; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 22:54:38,215 INFO [Listener at localhost.localdomain/41563] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4/f1/e2550728673445b38d7125048b0f558d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678575277677; access_time=1678575276852; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 22:54:38,266 INFO [Listener at localhost.localdomain/41563] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4/f1/c3db4262a2674eaea6282be11a61f41f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678575276838; access_time=1678575276023; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 22:54:38,266 INFO [Listener at localhost.localdomain/41563] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4/f1/e2550728673445b38d7125048b0f558d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678575277677; access_time=1678575276852; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 22:54:38,317 INFO [Listener at localhost.localdomain/41563] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4/f1/c3db4262a2674eaea6282be11a61f41f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678575276838; access_time=1678575276023; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 22:54:38,317 INFO [Listener at localhost.localdomain/41563] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4/f1/e2550728673445b38d7125048b0f558d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678575277677; access_time=1678575276852; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 22:54:38,368 INFO [Listener at localhost.localdomain/41563] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4/f1/c3db4262a2674eaea6282be11a61f41f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678575276838; access_time=1678575276023; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 22:54:38,368 INFO [Listener at localhost.localdomain/41563] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4/f1/e2550728673445b38d7125048b0f558d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678575277677; access_time=1678575276852; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 22:54:38,419 INFO [Listener at localhost.localdomain/41563] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4/f1/c3db4262a2674eaea6282be11a61f41f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678575276838; access_time=1678575276023; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 22:54:38,419 INFO [Listener at localhost.localdomain/41563] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4/f1/e2550728673445b38d7125048b0f558d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678575277677; access_time=1678575276852; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 22:54:38,470 INFO [Listener at localhost.localdomain/41563] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4/f1/c3db4262a2674eaea6282be11a61f41f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678575276838; access_time=1678575276023; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 22:54:38,470 INFO [Listener at localhost.localdomain/41563] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4/f1/e2550728673445b38d7125048b0f558d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678575277677; access_time=1678575276852; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 22:54:38,522 INFO [Listener at localhost.localdomain/41563] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4/f1/c3db4262a2674eaea6282be11a61f41f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678575276838; access_time=1678575276023; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 22:54:38,522 INFO [Listener at localhost.localdomain/41563] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4/f1/e2550728673445b38d7125048b0f558d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678575277677; access_time=1678575276852; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 22:54:38,542 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230311e404b3fbb0fb4f6589abb5b55415a13c to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230311e404b3fbb0fb4f6589abb5b55415a13c 2023-03-11 22:54:38,544 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230311 table='testGetAfterCompaction' column='f1' 2023-03-11 22:54:38,557 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-11 22:54:38,558 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:46816, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-11 22:54:38,563 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-11 22:54:38,565 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:52366, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-11 22:54:38,573 INFO [Listener at localhost.localdomain/41563] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4/f1/c3db4262a2674eaea6282be11a61f41f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678575276838; access_time=1678575276023; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 22:54:38,573 INFO [Listener at localhost.localdomain/41563] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4/f1/e2550728673445b38d7125048b0f558d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678575277677; access_time=1678575276852; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 22:54:38,573 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230311/f1/9f22f3a1635744ed9ab2ac00d2338a7e first=Optional[r1] last=Optional[r2] 2023-03-11 22:54:38,574 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testGetAfterCompaction,,1678575273895.257685b4306531b32961d1c4912a3ad4., hostname=jenkins-hbase20.apache.org,41843,1678575183185, seqNum=2 for row with hfile group [{f1,hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230311/f1/9f22f3a1635744ed9ab2ac00d2338a7e}] 2023-03-11 22:54:38,578 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230311/f1/9f22f3a1635744ed9ab2ac00d2338a7e for inclusion in 257685b4306531b32961d1c4912a3ad4/f1 2023-03-11 22:54:38,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(775): HFile bounds: first=r1 last=r2 2023-03-11 22:54:38,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(777): Region bounds: first= last= 2023-03-11 22:54:38,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HRegion(2446): Flush status journal for 257685b4306531b32961d1c4912a3ad4: 2023-03-11 22:54:38,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230311/f1/9f22f3a1635744ed9ab2ac00d2338a7e to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testGetAfterCompaction__9ueiegv9fh2c3rgpt75oghh9jf1sgbq7mpt5it8spsb2huv0ih46hlnls6om159k/f1/9f22f3a1635744ed9ab2ac00d2338a7e 2023-03-11 22:54:38,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testGetAfterCompaction__9ueiegv9fh2c3rgpt75oghh9jf1sgbq7mpt5it8spsb2huv0ih46hlnls6om159k/f1/9f22f3a1635744ed9ab2ac00d2338a7e as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4/f1/64ff209939fc44bfb34312fef1ef05f5_SeqId_12_ 2023-03-11 22:54:38,585 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testGetAfterCompaction__9ueiegv9fh2c3rgpt75oghh9jf1sgbq7mpt5it8spsb2huv0ih46hlnls6om159k/f1/9f22f3a1635744ed9ab2ac00d2338a7e into 257685b4306531b32961d1c4912a3ad4/f1 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4/f1/64ff209939fc44bfb34312fef1ef05f5_SeqId_12_ - updating store file list. 2023-03-11 22:54:38,589 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4/f1/64ff209939fc44bfb34312fef1ef05f5_SeqId_12_ into 257685b4306531b32961d1c4912a3ad4/f1 2023-03-11 22:54:38,589 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testGetAfterCompaction__9ueiegv9fh2c3rgpt75oghh9jf1sgbq7mpt5it8spsb2huv0ih46hlnls6om159k/f1/9f22f3a1635744ed9ab2ac00d2338a7e into 257685b4306531b32961d1c4912a3ad4/f1 (new location: hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4/f1/64ff209939fc44bfb34312fef1ef05f5_SeqId_12_) 2023-03-11 22:54:38,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testGetAfterCompaction__9ueiegv9fh2c3rgpt75oghh9jf1sgbq7mpt5it8spsb2huv0ih46hlnls6om159k/f1/9f22f3a1635744ed9ab2ac00d2338a7e 2023-03-11 22:54:38,590 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(1912): 257685b4306531b32961d1c4912a3ad4/f1 is initiating minor compaction 2023-03-11 22:54:38,590 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@7ecbfb0; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-03-11 22:54:38,590 INFO [RS:0;jenkins-hbase20:41843-longCompactions-0] regionserver.HRegion(2259): Starting compaction of 257685b4306531b32961d1c4912a3ad4/f1 in testGetAfterCompaction,,1678575273895.257685b4306531b32961d1c4912a3ad4. 2023-03-11 22:54:38,590 INFO [RS:0;jenkins-hbase20:41843-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4/f1/e2550728673445b38d7125048b0f558d, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4/f1/64ff209939fc44bfb34312fef1ef05f5_SeqId_12_] into tmpdir=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4/.tmp, totalSize=10.0 K 2023-03-11 22:54:38,590 DEBUG [RS:0;jenkins-hbase20:41843-longCompactions-0] compactions.Compactor(207): Compacting e2550728673445b38d7125048b0f558d, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=9 2023-03-11 22:54:38,590 DEBUG [RS:0;jenkins-hbase20:41843-longCompactions-0] compactions.Compactor(207): Compacting 64ff209939fc44bfb34312fef1ef05f5_SeqId_12_, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13 2023-03-11 22:54:38,592 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230311 table='testGetAfterCompaction' column='f1' 2023-03-11 22:54:38,593 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 22:54:38,595 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023031164da6883033b4617aba158501b707a97 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023031164da6883033b4617aba158501b707a97 2023-03-11 22:54:38,597 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202303119be6c0fd3c47468ab524808a0a125420 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202303119be6c0fd3c47468ab524808a0a125420 2023-03-11 22:54:38,597 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testGetAfterCompaction 2 expired mob files are deleted 2023-03-11 22:54:38,597 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230311' 2023-03-11 22:54:38,597 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230311 for table='testGetAfterCompaction' and column='f1' 2023-03-11 22:54:38,597 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] compactions.PartitionedMobCompactor(354): After compaction, there are 1 mob files. table='testGetAfterCompaction' column='f1' 2023-03-11 22:54:38,598 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] mob.MobUtils(840): end MOB compaction of files for table='testGetAfterCompaction', column='f1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-11 22:54:38,599 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=74, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-03-11 22:54:38,600 INFO [RS:0;jenkins-hbase20:41843-longCompactions-0] throttle.PressureAwareThroughputController(145): 257685b4306531b32961d1c4912a3ad4#f1#compaction#77 average throughput is 0.08 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-11 22:54:38,600 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=74, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE in 899 msec 2023-03-11 22:54:38,623 INFO [Listener at localhost.localdomain/41563] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4/f1/64ff209939fc44bfb34312fef1ef05f5_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1678575278533; access_time=1678575277717; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-11 22:54:38,624 INFO [Listener at localhost.localdomain/41563] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4/f1/c3db4262a2674eaea6282be11a61f41f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678575276838; access_time=1678575276023; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 22:54:38,624 INFO [Listener at localhost.localdomain/41563] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4/f1/e2550728673445b38d7125048b0f558d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678575277677; access_time=1678575276852; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 22:54:38,627 DEBUG [Listener at localhost.localdomain/41563] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-03-11 22:54:38,630 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:46826, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-03-11 22:54:38,630 INFO [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=41843] regionserver.RSRpcServices(1662): Compacting testGetAfterCompaction,,1678575273895.257685b4306531b32961d1c4912a3ad4. 2023-03-11 22:54:38,631 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=41843] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 2 compacting, 0 eligible, 16 blocking 2023-03-11 22:54:38,631 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=41843] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-03-11 22:54:38,631 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=41843] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-03-11 22:54:38,631 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=41843] regionserver.CompactSplit(415): Not compacting testGetAfterCompaction,,1678575273895.257685b4306531b32961d1c4912a3ad4. because compaction request was cancelled 2023-03-11 22:54:38,682 INFO [Listener at localhost.localdomain/41563] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4/f1/64ff209939fc44bfb34312fef1ef05f5_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1678575278533; access_time=1678575277717; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-11 22:54:38,683 INFO [Listener at localhost.localdomain/41563] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4/f1/c3db4262a2674eaea6282be11a61f41f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678575276838; access_time=1678575276023; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 22:54:38,683 INFO [Listener at localhost.localdomain/41563] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4/f1/e2550728673445b38d7125048b0f558d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678575277677; access_time=1678575276852; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 22:54:38,734 INFO [Listener at localhost.localdomain/41563] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4/f1/64ff209939fc44bfb34312fef1ef05f5_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1678575278533; access_time=1678575277717; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-11 22:54:38,734 INFO [Listener at localhost.localdomain/41563] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4/f1/c3db4262a2674eaea6282be11a61f41f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678575276838; access_time=1678575276023; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 22:54:38,734 INFO [Listener at localhost.localdomain/41563] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4/f1/e2550728673445b38d7125048b0f558d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678575277677; access_time=1678575276852; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 22:54:38,785 INFO [Listener at localhost.localdomain/41563] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4/f1/64ff209939fc44bfb34312fef1ef05f5_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1678575278533; access_time=1678575277717; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-11 22:54:38,785 INFO [Listener at localhost.localdomain/41563] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4/f1/c3db4262a2674eaea6282be11a61f41f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678575276838; access_time=1678575276023; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 22:54:38,785 INFO [Listener at localhost.localdomain/41563] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4/f1/e2550728673445b38d7125048b0f558d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678575277677; access_time=1678575276852; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 22:54:38,836 INFO [Listener at localhost.localdomain/41563] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4/f1/64ff209939fc44bfb34312fef1ef05f5_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1678575278533; access_time=1678575277717; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-11 22:54:38,837 INFO [Listener at localhost.localdomain/41563] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4/f1/c3db4262a2674eaea6282be11a61f41f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678575276838; access_time=1678575276023; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 22:54:38,837 INFO [Listener at localhost.localdomain/41563] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4/f1/e2550728673445b38d7125048b0f558d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678575277677; access_time=1678575276852; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 22:54:38,888 INFO [Listener at localhost.localdomain/41563] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4/f1/64ff209939fc44bfb34312fef1ef05f5_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1678575278533; access_time=1678575277717; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-11 22:54:38,888 INFO [Listener at localhost.localdomain/41563] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4/f1/c3db4262a2674eaea6282be11a61f41f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678575276838; access_time=1678575276023; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 22:54:38,888 INFO [Listener at localhost.localdomain/41563] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4/f1/e2550728673445b38d7125048b0f558d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678575277677; access_time=1678575276852; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 22:54:38,938 INFO [Listener at localhost.localdomain/41563] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4/f1/64ff209939fc44bfb34312fef1ef05f5_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1678575278533; access_time=1678575277717; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-11 22:54:38,939 INFO [Listener at localhost.localdomain/41563] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4/f1/c3db4262a2674eaea6282be11a61f41f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678575276838; access_time=1678575276023; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 22:54:38,939 INFO [Listener at localhost.localdomain/41563] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4/f1/e2550728673445b38d7125048b0f558d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678575277677; access_time=1678575276852; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 22:54:38,989 INFO [Listener at localhost.localdomain/41563] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4/f1/64ff209939fc44bfb34312fef1ef05f5_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1678575278533; access_time=1678575277717; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-11 22:54:38,990 INFO [Listener at localhost.localdomain/41563] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4/f1/c3db4262a2674eaea6282be11a61f41f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678575276838; access_time=1678575276023; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 22:54:38,990 INFO [Listener at localhost.localdomain/41563] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4/f1/e2550728673445b38d7125048b0f558d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678575277677; access_time=1678575276852; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 22:54:39,041 INFO [Listener at localhost.localdomain/41563] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4/f1/64ff209939fc44bfb34312fef1ef05f5_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1678575278533; access_time=1678575277717; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-11 22:54:39,041 INFO [Listener at localhost.localdomain/41563] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4/f1/c3db4262a2674eaea6282be11a61f41f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678575276838; access_time=1678575276023; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 22:54:39,041 INFO [Listener at localhost.localdomain/41563] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4/f1/e2550728673445b38d7125048b0f558d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678575277677; access_time=1678575276852; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 22:54:39,092 INFO [Listener at localhost.localdomain/41563] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4/f1/64ff209939fc44bfb34312fef1ef05f5_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1678575278533; access_time=1678575277717; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-11 22:54:39,093 INFO [Listener at localhost.localdomain/41563] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4/f1/c3db4262a2674eaea6282be11a61f41f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678575276838; access_time=1678575276023; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 22:54:39,093 INFO [Listener at localhost.localdomain/41563] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4/f1/e2550728673445b38d7125048b0f558d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678575277677; access_time=1678575276852; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 22:54:39,144 INFO [Listener at localhost.localdomain/41563] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4/f1/64ff209939fc44bfb34312fef1ef05f5_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1678575278533; access_time=1678575277717; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-11 22:54:39,145 INFO [Listener at localhost.localdomain/41563] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4/f1/c3db4262a2674eaea6282be11a61f41f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678575276838; access_time=1678575276023; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 22:54:39,145 INFO [Listener at localhost.localdomain/41563] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4/f1/e2550728673445b38d7125048b0f558d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678575277677; access_time=1678575276852; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 22:54:39,196 INFO [Listener at localhost.localdomain/41563] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4/f1/64ff209939fc44bfb34312fef1ef05f5_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1678575278533; access_time=1678575277717; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-11 22:54:39,197 INFO [Listener at localhost.localdomain/41563] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4/f1/c3db4262a2674eaea6282be11a61f41f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678575276838; access_time=1678575276023; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 22:54:39,197 INFO [Listener at localhost.localdomain/41563] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4/f1/e2550728673445b38d7125048b0f558d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678575277677; access_time=1678575276852; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 22:54:39,248 INFO [Listener at localhost.localdomain/41563] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4/f1/64ff209939fc44bfb34312fef1ef05f5_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1678575278533; access_time=1678575277717; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-11 22:54:39,248 INFO [Listener at localhost.localdomain/41563] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4/f1/c3db4262a2674eaea6282be11a61f41f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678575276838; access_time=1678575276023; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 22:54:39,249 INFO [Listener at localhost.localdomain/41563] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4/f1/e2550728673445b38d7125048b0f558d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678575277677; access_time=1678575276852; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 22:54:39,300 INFO [Listener at localhost.localdomain/41563] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4/f1/64ff209939fc44bfb34312fef1ef05f5_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1678575278533; access_time=1678575277717; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-11 22:54:39,300 INFO [Listener at localhost.localdomain/41563] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4/f1/c3db4262a2674eaea6282be11a61f41f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678575276838; access_time=1678575276023; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 22:54:39,301 INFO [Listener at localhost.localdomain/41563] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4/f1/e2550728673445b38d7125048b0f558d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678575277677; access_time=1678575276852; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 22:54:39,352 INFO [Listener at localhost.localdomain/41563] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4/f1/64ff209939fc44bfb34312fef1ef05f5_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1678575278533; access_time=1678575277717; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-11 22:54:39,352 INFO [Listener at localhost.localdomain/41563] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4/f1/c3db4262a2674eaea6282be11a61f41f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678575276838; access_time=1678575276023; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 22:54:39,353 INFO [Listener at localhost.localdomain/41563] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4/f1/e2550728673445b38d7125048b0f558d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678575277677; access_time=1678575276852; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 22:54:39,404 INFO [Listener at localhost.localdomain/41563] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4/f1/64ff209939fc44bfb34312fef1ef05f5_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1678575278533; access_time=1678575277717; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-11 22:54:39,404 INFO [Listener at localhost.localdomain/41563] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4/f1/c3db4262a2674eaea6282be11a61f41f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678575276838; access_time=1678575276023; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 22:54:39,405 INFO [Listener at localhost.localdomain/41563] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4/f1/e2550728673445b38d7125048b0f558d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678575277677; access_time=1678575276852; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 22:54:39,420 DEBUG [RS:0;jenkins-hbase20:41843-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4/.tmp/f1/18dad4862d014f64a73490d38a142381 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4/f1/18dad4862d014f64a73490d38a142381 2023-03-11 22:54:39,427 INFO [RS:0;jenkins-hbase20:41843-longCompactions-0] regionserver.HStore(1652): Completed compaction of 2 file(s) in 257685b4306531b32961d1c4912a3ad4/f1 of 257685b4306531b32961d1c4912a3ad4 into 18dad4862d014f64a73490d38a142381(size=5.1 K), total size for store is 10.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-11 22:54:39,427 DEBUG [RS:0;jenkins-hbase20:41843-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for 257685b4306531b32961d1c4912a3ad4: 2023-03-11 22:54:39,427 INFO [RS:0;jenkins-hbase20:41843-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testGetAfterCompaction,,1678575273895.257685b4306531b32961d1c4912a3ad4., storeName=f1, fileCount=2, fileSize=10.0 K (4.9 K, 5.1 K), priority=2, time=1678575278590; duration=0sec 2023-03-11 22:54:39,428 DEBUG [RS:0;jenkins-hbase20:41843-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-11 22:54:39,456 INFO [Listener at localhost.localdomain/41563] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4/f1/18dad4862d014f64a73490d38a142381; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1678575279409; access_time=1678575278597; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 22:54:39,456 INFO [Listener at localhost.localdomain/41563] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4/f1/64ff209939fc44bfb34312fef1ef05f5_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1678575278533; access_time=1678575277717; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-11 22:54:39,457 INFO [Listener at localhost.localdomain/41563] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4/f1/c3db4262a2674eaea6282be11a61f41f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678575276838; access_time=1678575276023; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 22:54:39,457 INFO [Listener at localhost.localdomain/41563] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4/f1/e2550728673445b38d7125048b0f558d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678575277677; access_time=1678575276852; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 22:54:39,472 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4/f1/e2550728673445b38d7125048b0f558d, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4/f1/64ff209939fc44bfb34312fef1ef05f5_SeqId_12_] to archive 2023-03-11 22:54:39,474 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 22:54:39,478 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4/f1/e2550728673445b38d7125048b0f558d to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4/f1/e2550728673445b38d7125048b0f558d 2023-03-11 22:54:39,480 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4/f1/64ff209939fc44bfb34312fef1ef05f5_SeqId_12_ to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4/f1/64ff209939fc44bfb34312fef1ef05f5_SeqId_12_ 2023-03-11 22:54:39,508 INFO [Listener at localhost.localdomain/41563] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4/f1/18dad4862d014f64a73490d38a142381; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1678575279409; access_time=1678575278597; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 22:54:39,508 INFO [Listener at localhost.localdomain/41563] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4/f1/c3db4262a2674eaea6282be11a61f41f; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678575276838; access_time=1678575276023; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-11 22:54:39,634 INFO [Listener at localhost.localdomain/41563] client.HBaseAdmin$15(890): Started disable of testGetAfterCompaction 2023-03-11 22:54:39,640 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testGetAfterCompaction 2023-03-11 22:54:39,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure2.ProcedureExecutor(1029): Stored pid=75, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testGetAfterCompaction 2023-03-11 22:54:39,647 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678575279647"}]},"ts":"1678575279647"} 2023-03-11 22:54:39,649 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=DISABLING in hbase:meta 2023-03-11 22:54:39,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1227): Checking to see if procedure is done pid=75 2023-03-11 22:54:39,650 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testGetAfterCompaction to state=DISABLING 2023-03-11 22:54:39,652 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=75, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testGetAfterCompaction, region=257685b4306531b32961d1c4912a3ad4, UNASSIGN}] 2023-03-11 22:54:39,653 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=75, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testGetAfterCompaction, region=257685b4306531b32961d1c4912a3ad4, UNASSIGN 2023-03-11 22:54:39,653 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=257685b4306531b32961d1c4912a3ad4, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:39,654 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testGetAfterCompaction,,1678575273895.257685b4306531b32961d1c4912a3ad4.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1678575279653"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1678575279653"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678575279653"}]},"ts":"1678575279653"} 2023-03-11 22:54:39,655 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; CloseRegionProcedure 257685b4306531b32961d1c4912a3ad4, server=jenkins-hbase20.apache.org,41843,1678575183185}] 2023-03-11 22:54:39,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1227): Checking to see if procedure is done pid=75 2023-03-11 22:54:39,807 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close 257685b4306531b32961d1c4912a3ad4 2023-03-11 22:54:39,807 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 257685b4306531b32961d1c4912a3ad4, disabling compactions & flushes 2023-03-11 22:54:39,807 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testGetAfterCompaction,,1678575273895.257685b4306531b32961d1c4912a3ad4. 2023-03-11 22:54:39,807 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testGetAfterCompaction,,1678575273895.257685b4306531b32961d1c4912a3ad4. 2023-03-11 22:54:39,807 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testGetAfterCompaction,,1678575273895.257685b4306531b32961d1c4912a3ad4. after waiting 0 ms 2023-03-11 22:54:39,807 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testGetAfterCompaction,,1678575273895.257685b4306531b32961d1c4912a3ad4. 2023-03-11 22:54:39,813 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=1 2023-03-11 22:54:39,814 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro 2023-03-11 22:54:39,815 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testGetAfterCompaction,,1678575273895.257685b4306531b32961d1c4912a3ad4. 2023-03-11 22:54:39,815 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 257685b4306531b32961d1c4912a3ad4: 2023-03-11 22:54:39,817 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed 257685b4306531b32961d1c4912a3ad4 2023-03-11 22:54:39,818 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=257685b4306531b32961d1c4912a3ad4, regionState=CLOSED 2023-03-11 22:54:39,818 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testGetAfterCompaction,,1678575273895.257685b4306531b32961d1c4912a3ad4.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1678575279818"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678575279818"}]},"ts":"1678575279818"} 2023-03-11 22:54:39,822 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-03-11 22:54:39,822 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; CloseRegionProcedure 257685b4306531b32961d1c4912a3ad4, server=jenkins-hbase20.apache.org,41843,1678575183185 in 165 msec 2023-03-11 22:54:39,824 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=75 2023-03-11 22:54:39,824 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=75, state=SUCCESS; TransitRegionStateProcedure table=testGetAfterCompaction, region=257685b4306531b32961d1c4912a3ad4, UNASSIGN in 171 msec 2023-03-11 22:54:39,825 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678575279825"}]},"ts":"1678575279825"} 2023-03-11 22:54:39,826 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=DISABLED in hbase:meta 2023-03-11 22:54:39,828 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testGetAfterCompaction to state=DISABLED 2023-03-11 22:54:39,829 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=75, state=SUCCESS; DisableTableProcedure table=testGetAfterCompaction in 187 msec 2023-03-11 22:54:39,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1227): Checking to see if procedure is done pid=75 2023-03-11 22:54:39,952 INFO [Listener at localhost.localdomain/41563] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testGetAfterCompaction, procId: 75 completed 2023-03-11 22:54:39,962 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.HMaster$5(2228): Client=jenkins//148.251.75.209 delete testGetAfterCompaction 2023-03-11 22:54:39,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testGetAfterCompaction 2023-03-11 22:54:39,968 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-03-11 22:54:39,970 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=78, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-03-11 22:54:39,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1227): Checking to see if procedure is done pid=78 2023-03-11 22:54:39,972 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/.tmp/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4 2023-03-11 22:54:39,975 DEBUG [HFileArchiver-12] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/.tmp/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4/f1, FileablePath, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/.tmp/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4/recovered.edits] 2023-03-11 22:54:39,978 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/.tmp/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4/f1/18dad4862d014f64a73490d38a142381 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4/f1/18dad4862d014f64a73490d38a142381 2023-03-11 22:54:39,979 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/.tmp/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4/f1/c3db4262a2674eaea6282be11a61f41f to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4/f1/c3db4262a2674eaea6282be11a61f41f 2023-03-11 22:54:39,980 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/.tmp/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4/recovered.edits/15.seqid to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4/recovered.edits/15.seqid 2023-03-11 22:54:39,981 DEBUG [HFileArchiver-12] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/.tmp/data/default/testGetAfterCompaction/257685b4306531b32961d1c4912a3ad4 2023-03-11 22:54:39,981 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testGetAfterCompaction regions 2023-03-11 22:54:39,981 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0 2023-03-11 22:54:39,982 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1] 2023-03-11 22:54:39,985 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230311e404b3fbb0fb4f6589abb5b55415a13c to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230311e404b3fbb0fb4f6589abb5b55415a13c 2023-03-11 22:54:39,985 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0 2023-03-11 22:54:39,987 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=78, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-03-11 22:54:40,006 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testGetAfterCompaction from hbase:meta 2023-03-11 22:54:40,009 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testGetAfterCompaction' descriptor. 2023-03-11 22:54:40,010 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=78, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-03-11 22:54:40,010 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testGetAfterCompaction' from region states. 2023-03-11 22:54:40,010 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testGetAfterCompaction,,1678575273895.257685b4306531b32961d1c4912a3ad4.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1678575280010"}]},"ts":"9223372036854775807"} 2023-03-11 22:54:40,011 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-03-11 22:54:40,012 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 257685b4306531b32961d1c4912a3ad4, NAME => 'testGetAfterCompaction,,1678575273895.257685b4306531b32961d1c4912a3ad4.', STARTKEY => '', ENDKEY => ''}] 2023-03-11 22:54:40,012 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testGetAfterCompaction' as deleted. 2023-03-11 22:54:40,012 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1678575280012"}]},"ts":"9223372036854775807"} 2023-03-11 22:54:40,013 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testGetAfterCompaction state from META 2023-03-11 22:54:40,015 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=78, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-03-11 22:54:40,015 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; DeleteTableProcedure table=testGetAfterCompaction in 52 msec 2023-03-11 22:54:40,072 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1227): Checking to see if procedure is done pid=78 2023-03-11 22:54:40,072 INFO [Listener at localhost.localdomain/41563] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testGetAfterCompaction, procId: 78 completed 2023-03-11 22:54:40,087 INFO [Listener at localhost.localdomain/41563] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testGetAfterCompaction Thread=244 (was 239) - Thread LEAK? -, OpenFileDescriptor=608 (was 613), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=216 (was 246), ProcessCount=168 (was 168), AvailableMemoryMB=21555 (was 21559) 2023-03-11 22:54:40,099 INFO [Listener at localhost.localdomain/41563] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testCompactionWithHFileLink Thread=244, OpenFileDescriptor=608, MaxFileDescriptor=60000, SystemLoadAverage=216, ProcessCount=168, AvailableMemoryMB=21555 2023-03-11 22:54:40,101 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-03-11 22:54:40,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testCompactionWithHFileLink 2023-03-11 22:54:40,102 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_PRE_OPERATION 2023-03-11 22:54:40,103 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(697): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testCompactionWithHFileLink" procId is: 79 2023-03-11 22:54:40,103 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-11 22:54:40,103 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-03-11 22:54:40,105 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/.tmp/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43 2023-03-11 22:54:40,105 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/.tmp/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236 2023-03-11 22:54:40,106 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/.tmp/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7 2023-03-11 22:54:40,106 DEBUG [HFileArchiver-13] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/.tmp/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43 empty. 2023-03-11 22:54:40,106 DEBUG [HFileArchiver-14] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/.tmp/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236 empty. 2023-03-11 22:54:40,106 DEBUG [HFileArchiver-13] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/.tmp/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43 2023-03-11 22:54:40,106 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/.tmp/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7 empty. 2023-03-11 22:54:40,106 DEBUG [HFileArchiver-14] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/.tmp/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236 2023-03-11 22:54:40,106 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/.tmp/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7 2023-03-11 22:54:40,106 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testCompactionWithHFileLink regions 2023-03-11 22:54:40,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-03-11 22:54:40,406 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-03-11 22:54:40,520 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/.tmp/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000001 2023-03-11 22:54:40,523 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(7675): creating {ENCODED => f5ff2dc2c8d65f11f0ecb2681def8a43, NAME => 'testCompactionWithHFileLink,,1678575280100.f5ff2dc2c8d65f11f0ecb2681def8a43.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/.tmp 2023-03-11 22:54:40,524 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(7675): creating {ENCODED => 7189059ae0acaaffd2a7e63414af38f7, NAME => 'testCompactionWithHFileLink,2,1678575280100.7189059ae0acaaffd2a7e63414af38f7.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/.tmp 2023-03-11 22:54:40,525 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(7675): creating {ENCODED => c9557b829346f7133c6ea3c6c1b42236, NAME => 'testCompactionWithHFileLink,1,1678575280100.c9557b829346f7133c6ea3c6c1b42236.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/.tmp 2023-03-11 22:54:40,533 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1678575280100.7189059ae0acaaffd2a7e63414af38f7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-11 22:54:40,533 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1604): Closing 7189059ae0acaaffd2a7e63414af38f7, disabling compactions & flushes 2023-03-11 22:54:40,533 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1678575280100.7189059ae0acaaffd2a7e63414af38f7. 2023-03-11 22:54:40,533 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1678575280100.7189059ae0acaaffd2a7e63414af38f7. 2023-03-11 22:54:40,533 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1678575280100.7189059ae0acaaffd2a7e63414af38f7. after waiting 0 ms 2023-03-11 22:54:40,533 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1678575280100.7189059ae0acaaffd2a7e63414af38f7. 2023-03-11 22:54:40,533 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1678575280100.7189059ae0acaaffd2a7e63414af38f7. 2023-03-11 22:54:40,533 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1558): Region close journal for 7189059ae0acaaffd2a7e63414af38f7: 2023-03-11 22:54:40,534 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1678575280100.f5ff2dc2c8d65f11f0ecb2681def8a43.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-11 22:54:40,534 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1604): Closing f5ff2dc2c8d65f11f0ecb2681def8a43, disabling compactions & flushes 2023-03-11 22:54:40,534 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1678575280100.f5ff2dc2c8d65f11f0ecb2681def8a43. 2023-03-11 22:54:40,534 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1678575280100.f5ff2dc2c8d65f11f0ecb2681def8a43. 2023-03-11 22:54:40,534 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1678575280100.f5ff2dc2c8d65f11f0ecb2681def8a43. after waiting 0 ms 2023-03-11 22:54:40,534 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1678575280100.f5ff2dc2c8d65f11f0ecb2681def8a43. 2023-03-11 22:54:40,534 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1678575280100.f5ff2dc2c8d65f11f0ecb2681def8a43. 2023-03-11 22:54:40,534 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1558): Region close journal for f5ff2dc2c8d65f11f0ecb2681def8a43: 2023-03-11 22:54:40,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-03-11 22:54:40,935 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1678575280100.c9557b829346f7133c6ea3c6c1b42236.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-11 22:54:40,935 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1604): Closing c9557b829346f7133c6ea3c6c1b42236, disabling compactions & flushes 2023-03-11 22:54:40,935 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1678575280100.c9557b829346f7133c6ea3c6c1b42236. 2023-03-11 22:54:40,935 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1678575280100.c9557b829346f7133c6ea3c6c1b42236. 2023-03-11 22:54:40,935 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1678575280100.c9557b829346f7133c6ea3c6c1b42236. after waiting 0 ms 2023-03-11 22:54:40,936 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1678575280100.c9557b829346f7133c6ea3c6c1b42236. 2023-03-11 22:54:40,936 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1678575280100.c9557b829346f7133c6ea3c6c1b42236. 2023-03-11 22:54:40,936 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1558): Region close journal for c9557b829346f7133c6ea3c6c1b42236: 2023-03-11 22:54:40,940 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_ADD_TO_META 2023-03-11 22:54:40,943 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1678575280100.7189059ae0acaaffd2a7e63414af38f7.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1678575280942"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678575280942"}]},"ts":"1678575280942"} 2023-03-11 22:54:40,943 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1678575280100.f5ff2dc2c8d65f11f0ecb2681def8a43.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1678575280942"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678575280942"}]},"ts":"1678575280942"} 2023-03-11 22:54:40,943 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1678575280100.c9557b829346f7133c6ea3c6c1b42236.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1678575280942"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678575280942"}]},"ts":"1678575280942"} 2023-03-11 22:54:40,946 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-03-11 22:54:40,947 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-11 22:54:40,947 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678575280947"}]},"ts":"1678575280947"} 2023-03-11 22:54:40,949 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLING in hbase:meta 2023-03-11 22:54:40,955 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f5ff2dc2c8d65f11f0ecb2681def8a43, ASSIGN}, {pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=c9557b829346f7133c6ea3c6c1b42236, ASSIGN}, {pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=7189059ae0acaaffd2a7e63414af38f7, ASSIGN}] 2023-03-11 22:54:40,957 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=7189059ae0acaaffd2a7e63414af38f7, ASSIGN 2023-03-11 22:54:40,957 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=c9557b829346f7133c6ea3c6c1b42236, ASSIGN 2023-03-11 22:54:40,957 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f5ff2dc2c8d65f11f0ecb2681def8a43, ASSIGN 2023-03-11 22:54:40,958 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=7189059ae0acaaffd2a7e63414af38f7, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,41843,1678575183185; forceNewPlan=false, retain=false 2023-03-11 22:54:40,958 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=c9557b829346f7133c6ea3c6c1b42236, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,41843,1678575183185; forceNewPlan=false, retain=false 2023-03-11 22:54:40,958 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f5ff2dc2c8d65f11f0ecb2681def8a43, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,41843,1678575183185; forceNewPlan=false, retain=false 2023-03-11 22:54:41,110 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=82 updating hbase:meta row=7189059ae0acaaffd2a7e63414af38f7, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:41,110 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=c9557b829346f7133c6ea3c6c1b42236, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:41,110 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=f5ff2dc2c8d65f11f0ecb2681def8a43, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:41,111 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1678575280100.c9557b829346f7133c6ea3c6c1b42236.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1678575281110"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1678575281110"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678575281110"}]},"ts":"1678575281110"} 2023-03-11 22:54:41,111 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1678575280100.7189059ae0acaaffd2a7e63414af38f7.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1678575281110"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1678575281110"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678575281110"}]},"ts":"1678575281110"} 2023-03-11 22:54:41,111 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1678575280100.f5ff2dc2c8d65f11f0ecb2681def8a43.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1678575281110"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1678575281110"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678575281110"}]},"ts":"1678575281110"} 2023-03-11 22:54:41,113 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=83, ppid=81, state=RUNNABLE; OpenRegionProcedure c9557b829346f7133c6ea3c6c1b42236, server=jenkins-hbase20.apache.org,41843,1678575183185}] 2023-03-11 22:54:41,115 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=84, ppid=82, state=RUNNABLE; OpenRegionProcedure 7189059ae0acaaffd2a7e63414af38f7, server=jenkins-hbase20.apache.org,41843,1678575183185}] 2023-03-11 22:54:41,118 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=80, state=RUNNABLE; OpenRegionProcedure f5ff2dc2c8d65f11f0ecb2681def8a43, server=jenkins-hbase20.apache.org,41843,1678575183185}] 2023-03-11 22:54:41,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-03-11 22:54:41,273 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,,1678575280100.f5ff2dc2c8d65f11f0ecb2681def8a43. 2023-03-11 22:54:41,274 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f5ff2dc2c8d65f11f0ecb2681def8a43, NAME => 'testCompactionWithHFileLink,,1678575280100.f5ff2dc2c8d65f11f0ecb2681def8a43.', STARTKEY => '', ENDKEY => '1'} 2023-03-11 22:54:41,274 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink f5ff2dc2c8d65f11f0ecb2681def8a43 2023-03-11 22:54:41,275 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1678575280100.f5ff2dc2c8d65f11f0ecb2681def8a43.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-11 22:54:41,275 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for f5ff2dc2c8d65f11f0ecb2681def8a43 2023-03-11 22:54:41,275 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for f5ff2dc2c8d65f11f0ecb2681def8a43 2023-03-11 22:54:41,278 INFO [StoreOpener-f5ff2dc2c8d65f11f0ecb2681def8a43-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region f5ff2dc2c8d65f11f0ecb2681def8a43 2023-03-11 22:54:41,281 DEBUG [StoreOpener-f5ff2dc2c8d65f11f0ecb2681def8a43-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family1 2023-03-11 22:54:41,281 DEBUG [StoreOpener-f5ff2dc2c8d65f11f0ecb2681def8a43-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family1 2023-03-11 22:54:41,282 INFO [StoreOpener-f5ff2dc2c8d65f11f0ecb2681def8a43-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f5ff2dc2c8d65f11f0ecb2681def8a43 columnFamilyName family1 2023-03-11 22:54:41,283 INFO [StoreOpener-f5ff2dc2c8d65f11f0ecb2681def8a43-1] regionserver.HStore(310): Store=f5ff2dc2c8d65f11f0ecb2681def8a43/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-11 22:54:41,283 INFO [StoreOpener-f5ff2dc2c8d65f11f0ecb2681def8a43-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region f5ff2dc2c8d65f11f0ecb2681def8a43 2023-03-11 22:54:41,284 DEBUG [StoreOpener-f5ff2dc2c8d65f11f0ecb2681def8a43-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family2 2023-03-11 22:54:41,284 DEBUG [StoreOpener-f5ff2dc2c8d65f11f0ecb2681def8a43-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family2 2023-03-11 22:54:41,285 INFO [StoreOpener-f5ff2dc2c8d65f11f0ecb2681def8a43-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f5ff2dc2c8d65f11f0ecb2681def8a43 columnFamilyName family2 2023-03-11 22:54:41,285 INFO [StoreOpener-f5ff2dc2c8d65f11f0ecb2681def8a43-1] regionserver.HStore(310): Store=f5ff2dc2c8d65f11f0ecb2681def8a43/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-11 22:54:41,286 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43 2023-03-11 22:54:41,286 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43 2023-03-11 22:54:41,288 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-11 22:54:41,288 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for f5ff2dc2c8d65f11f0ecb2681def8a43 2023-03-11 22:54:41,290 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-11 22:54:41,290 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened f5ff2dc2c8d65f11f0ecb2681def8a43; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60174142, jitterRate=-0.1033354103565216}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-11 22:54:41,290 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for f5ff2dc2c8d65f11f0ecb2681def8a43: 2023-03-11 22:54:41,291 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,,1678575280100.f5ff2dc2c8d65f11f0ecb2681def8a43., pid=85, masterSystemTime=1678575281269 2023-03-11 22:54:41,292 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,,1678575280100.f5ff2dc2c8d65f11f0ecb2681def8a43. 2023-03-11 22:54:41,292 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,,1678575280100.f5ff2dc2c8d65f11f0ecb2681def8a43. 2023-03-11 22:54:41,292 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,2,1678575280100.7189059ae0acaaffd2a7e63414af38f7. 2023-03-11 22:54:41,292 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7189059ae0acaaffd2a7e63414af38f7, NAME => 'testCompactionWithHFileLink,2,1678575280100.7189059ae0acaaffd2a7e63414af38f7.', STARTKEY => '2', ENDKEY => ''} 2023-03-11 22:54:41,292 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=f5ff2dc2c8d65f11f0ecb2681def8a43, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:41,292 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 7189059ae0acaaffd2a7e63414af38f7 2023-03-11 22:54:41,292 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1678575280100.7189059ae0acaaffd2a7e63414af38f7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-11 22:54:41,292 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,,1678575280100.f5ff2dc2c8d65f11f0ecb2681def8a43.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1678575281292"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1678575281292"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678575281292"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678575281292"}]},"ts":"1678575281292"} 2023-03-11 22:54:41,292 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 7189059ae0acaaffd2a7e63414af38f7 2023-03-11 22:54:41,292 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 7189059ae0acaaffd2a7e63414af38f7 2023-03-11 22:54:41,293 INFO [StoreOpener-7189059ae0acaaffd2a7e63414af38f7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 7189059ae0acaaffd2a7e63414af38f7 2023-03-11 22:54:41,295 DEBUG [StoreOpener-7189059ae0acaaffd2a7e63414af38f7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family1 2023-03-11 22:54:41,295 DEBUG [StoreOpener-7189059ae0acaaffd2a7e63414af38f7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family1 2023-03-11 22:54:41,295 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=85, resume processing ppid=80 2023-03-11 22:54:41,295 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=80, state=SUCCESS; OpenRegionProcedure f5ff2dc2c8d65f11f0ecb2681def8a43, server=jenkins-hbase20.apache.org,41843,1678575183185 in 177 msec 2023-03-11 22:54:41,295 INFO [StoreOpener-7189059ae0acaaffd2a7e63414af38f7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7189059ae0acaaffd2a7e63414af38f7 columnFamilyName family1 2023-03-11 22:54:41,296 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=80, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f5ff2dc2c8d65f11f0ecb2681def8a43, ASSIGN in 342 msec 2023-03-11 22:54:41,296 INFO [StoreOpener-7189059ae0acaaffd2a7e63414af38f7-1] regionserver.HStore(310): Store=7189059ae0acaaffd2a7e63414af38f7/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-11 22:54:41,296 INFO [StoreOpener-7189059ae0acaaffd2a7e63414af38f7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 7189059ae0acaaffd2a7e63414af38f7 2023-03-11 22:54:41,297 DEBUG [StoreOpener-7189059ae0acaaffd2a7e63414af38f7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family2 2023-03-11 22:54:41,297 DEBUG [StoreOpener-7189059ae0acaaffd2a7e63414af38f7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family2 2023-03-11 22:54:41,298 INFO [StoreOpener-7189059ae0acaaffd2a7e63414af38f7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7189059ae0acaaffd2a7e63414af38f7 columnFamilyName family2 2023-03-11 22:54:41,298 INFO [StoreOpener-7189059ae0acaaffd2a7e63414af38f7-1] regionserver.HStore(310): Store=7189059ae0acaaffd2a7e63414af38f7/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-11 22:54:41,299 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7 2023-03-11 22:54:41,300 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7 2023-03-11 22:54:41,301 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-11 22:54:41,302 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 7189059ae0acaaffd2a7e63414af38f7 2023-03-11 22:54:41,303 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-11 22:54:41,304 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 7189059ae0acaaffd2a7e63414af38f7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71105633, jitterRate=0.0595564991235733}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-11 22:54:41,304 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 7189059ae0acaaffd2a7e63414af38f7: 2023-03-11 22:54:41,304 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,2,1678575280100.7189059ae0acaaffd2a7e63414af38f7., pid=84, masterSystemTime=1678575281269 2023-03-11 22:54:41,305 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,2,1678575280100.7189059ae0acaaffd2a7e63414af38f7. 2023-03-11 22:54:41,305 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,2,1678575280100.7189059ae0acaaffd2a7e63414af38f7. 2023-03-11 22:54:41,305 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,1,1678575280100.c9557b829346f7133c6ea3c6c1b42236. 2023-03-11 22:54:41,305 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c9557b829346f7133c6ea3c6c1b42236, NAME => 'testCompactionWithHFileLink,1,1678575280100.c9557b829346f7133c6ea3c6c1b42236.', STARTKEY => '1', ENDKEY => '2'} 2023-03-11 22:54:41,306 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=82 updating hbase:meta row=7189059ae0acaaffd2a7e63414af38f7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:41,306 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink c9557b829346f7133c6ea3c6c1b42236 2023-03-11 22:54:41,306 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,2,1678575280100.7189059ae0acaaffd2a7e63414af38f7.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1678575281305"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1678575281305"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678575281305"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678575281305"}]},"ts":"1678575281305"} 2023-03-11 22:54:41,306 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1678575280100.c9557b829346f7133c6ea3c6c1b42236.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-11 22:54:41,306 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for c9557b829346f7133c6ea3c6c1b42236 2023-03-11 22:54:41,306 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for c9557b829346f7133c6ea3c6c1b42236 2023-03-11 22:54:41,307 INFO [StoreOpener-c9557b829346f7133c6ea3c6c1b42236-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region c9557b829346f7133c6ea3c6c1b42236 2023-03-11 22:54:41,308 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=84, resume processing ppid=82 2023-03-11 22:54:41,308 DEBUG [StoreOpener-c9557b829346f7133c6ea3c6c1b42236-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family1 2023-03-11 22:54:41,308 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=84, ppid=82, state=SUCCESS; OpenRegionProcedure 7189059ae0acaaffd2a7e63414af38f7, server=jenkins-hbase20.apache.org,41843,1678575183185 in 192 msec 2023-03-11 22:54:41,309 DEBUG [StoreOpener-c9557b829346f7133c6ea3c6c1b42236-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family1 2023-03-11 22:54:41,309 INFO [StoreOpener-c9557b829346f7133c6ea3c6c1b42236-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c9557b829346f7133c6ea3c6c1b42236 columnFamilyName family1 2023-03-11 22:54:41,310 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=7189059ae0acaaffd2a7e63414af38f7, ASSIGN in 353 msec 2023-03-11 22:54:41,310 INFO [StoreOpener-c9557b829346f7133c6ea3c6c1b42236-1] regionserver.HStore(310): Store=c9557b829346f7133c6ea3c6c1b42236/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-11 22:54:41,311 INFO [StoreOpener-c9557b829346f7133c6ea3c6c1b42236-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region c9557b829346f7133c6ea3c6c1b42236 2023-03-11 22:54:41,312 DEBUG [StoreOpener-c9557b829346f7133c6ea3c6c1b42236-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family2 2023-03-11 22:54:41,312 DEBUG [StoreOpener-c9557b829346f7133c6ea3c6c1b42236-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family2 2023-03-11 22:54:41,313 INFO [StoreOpener-c9557b829346f7133c6ea3c6c1b42236-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c9557b829346f7133c6ea3c6c1b42236 columnFamilyName family2 2023-03-11 22:54:41,314 INFO [StoreOpener-c9557b829346f7133c6ea3c6c1b42236-1] regionserver.HStore(310): Store=c9557b829346f7133c6ea3c6c1b42236/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-11 22:54:41,315 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236 2023-03-11 22:54:41,315 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236 2023-03-11 22:54:41,317 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-11 22:54:41,318 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for c9557b829346f7133c6ea3c6c1b42236 2023-03-11 22:54:41,321 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-11 22:54:41,321 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened c9557b829346f7133c6ea3c6c1b42236; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67859405, jitterRate=0.011183932423591614}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-11 22:54:41,321 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for c9557b829346f7133c6ea3c6c1b42236: 2023-03-11 22:54:41,322 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,1,1678575280100.c9557b829346f7133c6ea3c6c1b42236., pid=83, masterSystemTime=1678575281269 2023-03-11 22:54:41,323 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,1,1678575280100.c9557b829346f7133c6ea3c6c1b42236. 2023-03-11 22:54:41,323 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,1,1678575280100.c9557b829346f7133c6ea3c6c1b42236. 2023-03-11 22:54:41,323 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=c9557b829346f7133c6ea3c6c1b42236, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:41,324 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,1,1678575280100.c9557b829346f7133c6ea3c6c1b42236.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1678575281323"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1678575281323"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678575281323"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678575281323"}]},"ts":"1678575281323"} 2023-03-11 22:54:41,326 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=83, resume processing ppid=81 2023-03-11 22:54:41,326 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=83, ppid=81, state=SUCCESS; OpenRegionProcedure c9557b829346f7133c6ea3c6c1b42236, server=jenkins-hbase20.apache.org,41843,1678575183185 in 211 msec 2023-03-11 22:54:41,327 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=79 2023-03-11 22:54:41,327 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=c9557b829346f7133c6ea3c6c1b42236, ASSIGN in 373 msec 2023-03-11 22:54:41,327 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-11 22:54:41,328 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678575281327"}]},"ts":"1678575281327"} 2023-03-11 22:54:41,328 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLED in hbase:meta 2023-03-11 22:54:41,330 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_POST_OPERATION 2023-03-11 22:54:41,331 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; CreateTableProcedure table=testCompactionWithHFileLink in 1.2290 sec 2023-03-11 22:54:42,212 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-03-11 22:54:42,213 INFO [Listener at localhost.localdomain/41563] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testCompactionWithHFileLink, procId: 79 completed 2023-03-11 22:54:42,225 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1678575280100.f5ff2dc2c8d65f11f0ecb2681def8a43. with WAL disabled. Data may be lost in the event of a crash. 2023-03-11 22:54:42,226 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1678575280100.c9557b829346f7133c6ea3c6c1b42236. with WAL disabled. Data may be lost in the event of a crash. 2023-03-11 22:54:42,226 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1678575280100.7189059ae0acaaffd2a7e63414af38f7. with WAL disabled. Data may be lost in the event of a crash. 2023-03-11 22:54:42,228 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-11 22:54:42,230 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-03-11 22:54:42,230 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-03-11 22:54:42,230 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:54:42,230 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-03-11 22:54:42,230 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-03-11 22:54:42,230 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-11 22:54:42,231 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-11 22:54:42,231 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:42,231 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:54:42,231 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:54:42,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:54:42,232 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:42,232 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 22:54:42,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-11 22:54:42,232 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-11 22:54:42,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 22:54:42,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-11 22:54:42,232 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-03-11 22:54:42,232 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-03-11 22:54:42,232 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-03-11 22:54:42,232 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:54:42,233 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-03-11 22:54:42,233 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1678575280100.7189059ae0acaaffd2a7e63414af38f7. 2023-03-11 22:54:42,233 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1678575280100.7189059ae0acaaffd2a7e63414af38f7. started... 2023-03-11 22:54:42,233 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1678575280100.f5ff2dc2c8d65f11f0ecb2681def8a43. 2023-03-11 22:54:42,233 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1678575280100.f5ff2dc2c8d65f11f0ecb2681def8a43. started... 2023-03-11 22:54:42,233 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-11 22:54:42,234 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 22:54:42,233 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 7189059ae0acaaffd2a7e63414af38f7 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-03-11 22:54:42,233 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1678575280100.c9557b829346f7133c6ea3c6c1b42236. 2023-03-11 22:54:42,234 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing f5ff2dc2c8d65f11f0ecb2681def8a43 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-03-11 22:54:42,234 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1678575280100.c9557b829346f7133c6ea3c6c1b42236. started... 2023-03-11 22:54:42,235 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing c9557b829346f7133c6ea3c6c1b42236 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-03-11 22:54:42,649 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303113fc32ad601054ce383d790ba61e9b1d9 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202303113fc32ad601054ce383d790ba61e9b1d9 2023-03-11 22:54:42,649 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303119e2f565be17f40a48d173fb84aee091c to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202303119e2f565be17f40a48d173fb84aee091c 2023-03-11 22:54:42,650 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230311ecd72b1e22a74ca4941b5e1642c89708 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230311ecd72b1e22a74ca4941b5e1642c89708 2023-03-11 22:54:43,057 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/.tmp/family1/b71bc618951c43e69e774b42be4b0bef 2023-03-11 22:54:43,058 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/.tmp/family1/bd42d7e392e844e2a435e9965bbe4b52 2023-03-11 22:54:43,058 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/.tmp/family1/de777f4aa41a4d8fb92468da0d003d99 2023-03-11 22:54:43,483 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230311ab679c8580b747129707b59c422a1364 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230311ab679c8580b747129707b59c422a1364 2023-03-11 22:54:43,483 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230311559d25fc53c04f738cdf9dcbd65a3dba to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230311559d25fc53c04f738cdf9dcbd65a3dba 2023-03-11 22:54:43,483 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230311a5761f8506244c52b5425d6325f21461 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230311a5761f8506244c52b5425d6325f21461 2023-03-11 22:54:43,891 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/.tmp/family2/f0aea611a01547acbf71afe50f36b56e 2023-03-11 22:54:43,891 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/.tmp/family2/56a3feebc66c4f1b84e6eae2fe9cef71 2023-03-11 22:54:43,900 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/.tmp/family2/85d83795bb82460c9e80c58c7c9ee030 2023-03-11 22:54:43,902 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/.tmp/family1/de777f4aa41a4d8fb92468da0d003d99 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family1/de777f4aa41a4d8fb92468da0d003d99 2023-03-11 22:54:43,902 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/.tmp/family1/b71bc618951c43e69e774b42be4b0bef as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family1/b71bc618951c43e69e774b42be4b0bef 2023-03-11 22:54:43,905 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/.tmp/family1/bd42d7e392e844e2a435e9965bbe4b52 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family1/bd42d7e392e844e2a435e9965bbe4b52 2023-03-11 22:54:43,906 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family1/b71bc618951c43e69e774b42be4b0bef, entries=4, sequenceid=5, filesize=5.4 K 2023-03-11 22:54:43,906 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family1/de777f4aa41a4d8fb92468da0d003d99, entries=4, sequenceid=5, filesize=5.4 K 2023-03-11 22:54:43,907 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/.tmp/family2/56a3feebc66c4f1b84e6eae2fe9cef71 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family2/56a3feebc66c4f1b84e6eae2fe9cef71 2023-03-11 22:54:43,907 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/.tmp/family2/f0aea611a01547acbf71afe50f36b56e as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family2/f0aea611a01547acbf71afe50f36b56e 2023-03-11 22:54:43,909 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family1/bd42d7e392e844e2a435e9965bbe4b52, entries=4, sequenceid=5, filesize=5.4 K 2023-03-11 22:54:43,910 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/.tmp/family2/85d83795bb82460c9e80c58c7c9ee030 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family2/85d83795bb82460c9e80c58c7c9ee030 2023-03-11 22:54:43,912 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family2/56a3feebc66c4f1b84e6eae2fe9cef71, entries=2, sequenceid=5, filesize=5.1 K 2023-03-11 22:54:43,912 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family2/f0aea611a01547acbf71afe50f36b56e, entries=2, sequenceid=5, filesize=5.1 K 2023-03-11 22:54:43,913 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for f5ff2dc2c8d65f11f0ecb2681def8a43 in 1679ms, sequenceid=5, compaction requested=false 2023-03-11 22:54:43,913 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for c9557b829346f7133c6ea3c6c1b42236 in 1678ms, sequenceid=5, compaction requested=false 2023-03-11 22:54:43,913 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testCompactionWithHFileLink' 2023-03-11 22:54:43,913 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testCompactionWithHFileLink' 2023-03-11 22:54:43,914 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for f5ff2dc2c8d65f11f0ecb2681def8a43: 2023-03-11 22:54:43,914 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for c9557b829346f7133c6ea3c6c1b42236: 2023-03-11 22:54:43,914 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1678575280100.f5ff2dc2c8d65f11f0ecb2681def8a43. 2023-03-11 22:54:43,914 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1678575280100.c9557b829346f7133c6ea3c6c1b42236. 2023-03-11 22:54:43,914 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-11 22:54:43,914 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-11 22:54:43,915 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family2/85d83795bb82460c9e80c58c7c9ee030, entries=2, sequenceid=5, filesize=5.1 K 2023-03-11 22:54:43,916 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 7189059ae0acaaffd2a7e63414af38f7 in 1683ms, sequenceid=5, compaction requested=false 2023-03-11 22:54:43,916 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7189059ae0acaaffd2a7e63414af38f7: 2023-03-11 22:54:43,916 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1678575280100.7189059ae0acaaffd2a7e63414af38f7. 2023-03-11 22:54:43,916 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-11 22:54:43,916 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-11 22:54:43,916 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:43,916 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-03-11 22:54:43,916 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-03-11 22:54:43,917 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-11 22:54:43,917 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:43,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:43,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:54:43,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:54:43,917 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-11 22:54:43,917 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 22:54:43,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:54:43,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:54:43,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-11 22:54:43,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:43,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:54:43,918 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-03-11 22:54:43,918 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@14d6b9ab[Count = 0] remaining members to acquire global barrier 2023-03-11 22:54:43,918 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-03-11 22:54:43,918 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-11 22:54:43,919 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-11 22:54:43,919 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-11 22:54:43,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-11 22:54:43,919 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-03-11 22:54:43,919 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:43,919 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 22:54:43,919 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-03-11 22:54:43,919 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase20.apache.org,41843,1678575183185' in zk 2023-03-11 22:54:43,920 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:43,920 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-03-11 22:54:43,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:43,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:54:43,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:54:43,920 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:54:43,920 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-03-11 22:54:43,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:54:43,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:54:43,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-11 22:54:43,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:43,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:54:43,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-11 22:54:43,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:43,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase20.apache.org,41843,1678575183185': 2023-03-11 22:54:43,921 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-03-11 22:54:43,921 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-03-11 22:54:43,921 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 22:54:43,921 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 22:54:43,921 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-03-11 22:54:43,921 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 22:54:43,922 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-11 22:54:43,922 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-11 22:54:43,922 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-11 22:54:43,922 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:54:43,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-11 22:54:43,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-11 22:54:43,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:54:43,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:54:43,922 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:43,922 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:54:43,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:54:43,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:54:43,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-11 22:54:43,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-11 22:54:43,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:54:43,923 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:43,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-11 22:54:43,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:43,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:54:43,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-11 22:54:43,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:43,924 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:43,924 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:54:43,924 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-11 22:54:43,924 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:54:43,924 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:54:43,924 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:54:43,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:54:43,924 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-03-11 22:54:43,924 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 22:54:43,924 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-11 22:54:43,924 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-03-11 22:54:43,924 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:43,925 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:54:43,925 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-03-11 22:54:43,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:54:43,925 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-11 22:54:43,925 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 22:54:43,925 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-11 22:54:43,925 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-11 22:54:44,025 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 22:54:44,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 22:54:44,029 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1678575280100.f5ff2dc2c8d65f11f0ecb2681def8a43. with WAL disabled. Data may be lost in the event of a crash. 2023-03-11 22:54:44,030 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1678575280100.c9557b829346f7133c6ea3c6c1b42236. with WAL disabled. Data may be lost in the event of a crash. 2023-03-11 22:54:44,031 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1678575280100.7189059ae0acaaffd2a7e63414af38f7. with WAL disabled. Data may be lost in the event of a crash. 2023-03-11 22:54:44,035 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-11 22:54:44,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-03-11 22:54:44,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-03-11 22:54:44,038 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-03-11 22:54:44,038 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:54:44,038 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-03-11 22:54:44,038 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-03-11 22:54:44,039 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-11 22:54:44,039 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-11 22:54:44,040 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:54:44,040 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:44,040 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:54:44,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:54:44,040 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:44,040 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 22:54:44,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-11 22:54:44,041 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-11 22:54:44,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 22:54:44,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-11 22:54:44,041 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-03-11 22:54:44,042 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-03-11 22:54:44,042 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-03-11 22:54:44,042 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-03-11 22:54:44,042 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:54:44,042 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-03-11 22:54:44,042 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1678575280100.7189059ae0acaaffd2a7e63414af38f7. 2023-03-11 22:54:44,042 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1678575280100.7189059ae0acaaffd2a7e63414af38f7. started... 2023-03-11 22:54:44,042 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 7189059ae0acaaffd2a7e63414af38f7 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-03-11 22:54:44,045 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1678575280100.f5ff2dc2c8d65f11f0ecb2681def8a43. 2023-03-11 22:54:44,045 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-11 22:54:44,045 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1678575280100.c9557b829346f7133c6ea3c6c1b42236. 2023-03-11 22:54:44,045 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1678575280100.c9557b829346f7133c6ea3c6c1b42236. started... 2023-03-11 22:54:44,045 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1678575280100.f5ff2dc2c8d65f11f0ecb2681def8a43. started... 2023-03-11 22:54:44,045 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 22:54:44,045 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing c9557b829346f7133c6ea3c6c1b42236 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-03-11 22:54:44,045 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing f5ff2dc2c8d65f11f0ecb2681def8a43 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-03-11 22:54:44,472 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303117cac817e46b249e58838f77e044220eb to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202303117cac817e46b249e58838f77e044220eb 2023-03-11 22:54:44,474 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202303118527fef18c5e485c949f1cd3a30c3aaa to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202303118527fef18c5e485c949f1cd3a30c3aaa 2023-03-11 22:54:44,474 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230311eadcedaacb5d4629984edc323cb2ca58 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230311eadcedaacb5d4629984edc323cb2ca58 2023-03-11 22:54:44,881 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/.tmp/family1/792b51b4e7344f2bb05423e36d8dccac 2023-03-11 22:54:44,883 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/.tmp/family1/501392378a5d499b90c1edfbc30e4277 2023-03-11 22:54:44,883 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/.tmp/family1/6dcf1deb771d4f1684637d7e9f23839d 2023-03-11 22:54:44,905 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303118e7d78be23434c5fb4fc0045235c5514 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202303118e7d78be23434c5fb4fc0045235c5514 2023-03-11 22:54:45,311 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/.tmp/family2/9811e2f543154038a3c389b2b7bae676 2023-03-11 22:54:45,314 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303113056fe9b988046309ed8e7ae7ceb4086 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202303113056fe9b988046309ed8e7ae7ceb4086 2023-03-11 22:54:45,314 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202303112e82ff8048a34eeca5e178fe8ced73eb to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202303112e82ff8048a34eeca5e178fe8ced73eb 2023-03-11 22:54:45,317 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/.tmp/family1/6dcf1deb771d4f1684637d7e9f23839d as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family1/6dcf1deb771d4f1684637d7e9f23839d 2023-03-11 22:54:45,318 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-11 22:54:45,323 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family1/6dcf1deb771d4f1684637d7e9f23839d, entries=4, sequenceid=9, filesize=5.4 K 2023-03-11 22:54:45,324 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/.tmp/family2/9811e2f543154038a3c389b2b7bae676 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family2/9811e2f543154038a3c389b2b7bae676 2023-03-11 22:54:45,327 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family2/9811e2f543154038a3c389b2b7bae676, entries=2, sequenceid=9, filesize=5.1 K 2023-03-11 22:54:45,328 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for f5ff2dc2c8d65f11f0ecb2681def8a43 in 1283ms, sequenceid=9, compaction requested=false 2023-03-11 22:54:45,328 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for f5ff2dc2c8d65f11f0ecb2681def8a43: 2023-03-11 22:54:45,328 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1678575280100.f5ff2dc2c8d65f11f0ecb2681def8a43. 2023-03-11 22:54:45,328 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-11 22:54:45,724 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/.tmp/family2/22a1925811b2401c869aa7abba4e22f2 2023-03-11 22:54:45,725 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/.tmp/family2/08c74fbf215e40af9afa551a84198fdc 2023-03-11 22:54:45,735 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/.tmp/family1/792b51b4e7344f2bb05423e36d8dccac as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family1/792b51b4e7344f2bb05423e36d8dccac 2023-03-11 22:54:45,735 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/.tmp/family1/501392378a5d499b90c1edfbc30e4277 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family1/501392378a5d499b90c1edfbc30e4277 2023-03-11 22:54:45,740 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family1/792b51b4e7344f2bb05423e36d8dccac, entries=4, sequenceid=9, filesize=5.4 K 2023-03-11 22:54:45,740 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family1/501392378a5d499b90c1edfbc30e4277, entries=4, sequenceid=9, filesize=5.4 K 2023-03-11 22:54:45,741 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/.tmp/family2/22a1925811b2401c869aa7abba4e22f2 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family2/22a1925811b2401c869aa7abba4e22f2 2023-03-11 22:54:45,741 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/.tmp/family2/08c74fbf215e40af9afa551a84198fdc as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family2/08c74fbf215e40af9afa551a84198fdc 2023-03-11 22:54:45,745 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family2/22a1925811b2401c869aa7abba4e22f2, entries=2, sequenceid=9, filesize=5.1 K 2023-03-11 22:54:45,745 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family2/08c74fbf215e40af9afa551a84198fdc, entries=2, sequenceid=9, filesize=5.1 K 2023-03-11 22:54:45,745 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 7189059ae0acaaffd2a7e63414af38f7 in 1703ms, sequenceid=9, compaction requested=false 2023-03-11 22:54:45,745 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for c9557b829346f7133c6ea3c6c1b42236 in 1700ms, sequenceid=9, compaction requested=false 2023-03-11 22:54:45,745 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7189059ae0acaaffd2a7e63414af38f7: 2023-03-11 22:54:45,746 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for c9557b829346f7133c6ea3c6c1b42236: 2023-03-11 22:54:45,746 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1678575280100.7189059ae0acaaffd2a7e63414af38f7. 2023-03-11 22:54:45,746 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1678575280100.c9557b829346f7133c6ea3c6c1b42236. 2023-03-11 22:54:45,746 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-11 22:54:45,746 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-11 22:54:45,746 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-11 22:54:45,746 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:45,746 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-03-11 22:54:45,746 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-03-11 22:54:45,747 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:45,747 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-11 22:54:45,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:45,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:54:45,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:54:45,747 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-11 22:54:45,747 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 22:54:45,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:54:45,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:54:45,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-11 22:54:45,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:45,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:54:45,748 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-03-11 22:54:45,748 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@24e0e869[Count = 0] remaining members to acquire global barrier 2023-03-11 22:54:45,748 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-03-11 22:54:45,748 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-11 22:54:45,749 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-11 22:54:45,749 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-11 22:54:45,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-11 22:54:45,749 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-03-11 22:54:45,749 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-03-11 22:54:45,749 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase20.apache.org,41843,1678575183185' in zk 2023-03-11 22:54:45,749 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:45,749 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 22:54:45,750 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-03-11 22:54:45,750 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:45,750 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:54:45,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:45,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:54:45,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:54:45,750 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-03-11 22:54:45,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:54:45,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:54:45,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-11 22:54:45,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:45,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:54:45,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-11 22:54:45,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:45,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase20.apache.org,41843,1678575183185': 2023-03-11 22:54:45,753 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-03-11 22:54:45,753 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-03-11 22:54:45,753 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 22:54:45,753 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 22:54:45,753 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-03-11 22:54:45,753 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 22:54:45,754 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-11 22:54:45,754 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-11 22:54:45,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-11 22:54:45,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:54:45,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:54:45,754 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-11 22:54:45,754 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:54:45,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-11 22:54:45,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:54:45,755 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:45,755 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:54:45,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-11 22:54:45,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:54:45,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:54:45,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-11 22:54:45,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-11 22:54:45,756 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:45,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:45,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:54:45,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-11 22:54:45,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:45,757 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:45,757 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:54:45,757 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-11 22:54:45,757 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:54:45,758 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:54:45,758 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-03-11 22:54:45,757 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:54:45,758 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-03-11 22:54:45,758 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 22:54:45,757 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-11 22:54:45,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:54:45,758 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:45,758 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-11 22:54:45,758 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-11 22:54:45,758 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-11 22:54:45,758 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-03-11 22:54:45,758 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 22:54:45,758 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:54:45,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:54:45,858 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 22:54:45,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 22:54:45,863 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1678575280100.f5ff2dc2c8d65f11f0ecb2681def8a43. with WAL disabled. Data may be lost in the event of a crash. 2023-03-11 22:54:45,863 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1678575280100.c9557b829346f7133c6ea3c6c1b42236. with WAL disabled. Data may be lost in the event of a crash. 2023-03-11 22:54:45,864 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1678575280100.7189059ae0acaaffd2a7e63414af38f7. with WAL disabled. Data may be lost in the event of a crash. 2023-03-11 22:54:45,870 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-11 22:54:45,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-03-11 22:54:45,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-03-11 22:54:45,873 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-03-11 22:54:45,873 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:54:45,873 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-03-11 22:54:45,873 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-03-11 22:54:45,873 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-11 22:54:45,873 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-11 22:54:45,874 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:45,874 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:54:45,874 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:54:45,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:54:45,874 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:45,874 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 22:54:45,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-11 22:54:45,875 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-11 22:54:45,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 22:54:45,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-11 22:54:45,875 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-03-11 22:54:45,875 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-03-11 22:54:45,875 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-03-11 22:54:45,875 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-03-11 22:54:45,875 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:54:45,875 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-03-11 22:54:45,875 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1678575280100.7189059ae0acaaffd2a7e63414af38f7. 2023-03-11 22:54:45,875 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1678575280100.f5ff2dc2c8d65f11f0ecb2681def8a43. 2023-03-11 22:54:45,875 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-11 22:54:45,875 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 22:54:45,875 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1678575280100.f5ff2dc2c8d65f11f0ecb2681def8a43. started... 2023-03-11 22:54:45,875 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1678575280100.7189059ae0acaaffd2a7e63414af38f7. started... 2023-03-11 22:54:45,875 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1678575280100.c9557b829346f7133c6ea3c6c1b42236. 2023-03-11 22:54:45,876 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing f5ff2dc2c8d65f11f0ecb2681def8a43 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-03-11 22:54:45,876 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 7189059ae0acaaffd2a7e63414af38f7 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-03-11 22:54:45,876 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1678575280100.c9557b829346f7133c6ea3c6c1b42236. started... 2023-03-11 22:54:45,876 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing c9557b829346f7133c6ea3c6c1b42236 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-03-11 22:54:46,309 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303119f211bc34e194a71bf189bd5baf45037 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202303119f211bc34e194a71bf189bd5baf45037 2023-03-11 22:54:46,309 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303112d52c5edbd894361b1998c4735e4a082 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202303112d52c5edbd894361b1998c4735e4a082 2023-03-11 22:54:46,309 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230311d39059d225114219bb95e51a3bf73129 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230311d39059d225114219bb95e51a3bf73129 2023-03-11 22:54:46,326 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/.tmp/family1/a2c8cd3ba10746a5857f359843a355cb 2023-03-11 22:54:46,726 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/.tmp/family1/70a13ebdab6744bb8dd47dd67237f4ca 2023-03-11 22:54:46,727 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/.tmp/family1/18bc795cc708409888f506cea46a1ceb 2023-03-11 22:54:46,740 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230311bd6add52e77a495cb451a1c9ec966c72 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230311bd6add52e77a495cb451a1c9ec966c72 2023-03-11 22:54:46,745 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/.tmp/family2/79ebb06592894586af3575e3868c1041 2023-03-11 22:54:46,745 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202303113e6629ce680c49dea38070747438fc75 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202303113e6629ce680c49dea38070747438fc75 2023-03-11 22:54:46,748 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/.tmp/family1/a2c8cd3ba10746a5857f359843a355cb as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family1/a2c8cd3ba10746a5857f359843a355cb 2023-03-11 22:54:46,750 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/.tmp/family2/f8c70657fdc84511b043d1760c4a13b4 2023-03-11 22:54:46,752 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family1/a2c8cd3ba10746a5857f359843a355cb, entries=4, sequenceid=13, filesize=5.4 K 2023-03-11 22:54:46,752 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/.tmp/family1/18bc795cc708409888f506cea46a1ceb as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family1/18bc795cc708409888f506cea46a1ceb 2023-03-11 22:54:46,753 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/.tmp/family2/79ebb06592894586af3575e3868c1041 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family2/79ebb06592894586af3575e3868c1041 2023-03-11 22:54:46,755 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family2/79ebb06592894586af3575e3868c1041, entries=2, sequenceid=13, filesize=5.1 K 2023-03-11 22:54:46,755 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family1/18bc795cc708409888f506cea46a1ceb, entries=4, sequenceid=13, filesize=5.4 K 2023-03-11 22:54:46,756 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for f5ff2dc2c8d65f11f0ecb2681def8a43 in 880ms, sequenceid=13, compaction requested=true 2023-03-11 22:54:46,756 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/.tmp/family2/f8c70657fdc84511b043d1760c4a13b4 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family2/f8c70657fdc84511b043d1760c4a13b4 2023-03-11 22:54:46,756 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for f5ff2dc2c8d65f11f0ecb2681def8a43: 2023-03-11 22:54:46,756 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1678575280100.f5ff2dc2c8d65f11f0ecb2681def8a43. 2023-03-11 22:54:46,756 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-11 22:54:46,759 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family2/f8c70657fdc84511b043d1760c4a13b4, entries=2, sequenceid=13, filesize=5.1 K 2023-03-11 22:54:46,760 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for c9557b829346f7133c6ea3c6c1b42236 in 884ms, sequenceid=13, compaction requested=true 2023-03-11 22:54:46,760 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for c9557b829346f7133c6ea3c6c1b42236: 2023-03-11 22:54:46,760 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1678575280100.c9557b829346f7133c6ea3c6c1b42236. 2023-03-11 22:54:46,760 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-11 22:54:47,152 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303111fb665807e7c4ca1ae12fef6db1004d4 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202303111fb665807e7c4ca1ae12fef6db1004d4 2023-03-11 22:54:47,161 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/.tmp/family2/55033e843476407d82f5c58e2a278d03 2023-03-11 22:54:47,165 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/.tmp/family1/70a13ebdab6744bb8dd47dd67237f4ca as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family1/70a13ebdab6744bb8dd47dd67237f4ca 2023-03-11 22:54:47,170 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family1/70a13ebdab6744bb8dd47dd67237f4ca, entries=4, sequenceid=13, filesize=5.4 K 2023-03-11 22:54:47,171 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/.tmp/family2/55033e843476407d82f5c58e2a278d03 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family2/55033e843476407d82f5c58e2a278d03 2023-03-11 22:54:47,177 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family2/55033e843476407d82f5c58e2a278d03, entries=2, sequenceid=13, filesize=5.1 K 2023-03-11 22:54:47,178 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 7189059ae0acaaffd2a7e63414af38f7 in 1302ms, sequenceid=13, compaction requested=true 2023-03-11 22:54:47,178 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7189059ae0acaaffd2a7e63414af38f7: 2023-03-11 22:54:47,178 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1678575280100.7189059ae0acaaffd2a7e63414af38f7. 2023-03-11 22:54:47,178 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-11 22:54:47,178 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-11 22:54:47,178 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:47,178 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-03-11 22:54:47,178 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-03-11 22:54:47,179 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:47,180 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-11 22:54:47,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:47,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:54:47,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:54:47,180 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-11 22:54:47,180 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 22:54:47,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:54:47,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:54:47,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-11 22:54:47,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:47,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:54:47,182 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-03-11 22:54:47,182 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7146ba7e[Count = 0] remaining members to acquire global barrier 2023-03-11 22:54:47,182 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-03-11 22:54:47,182 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-11 22:54:47,183 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-11 22:54:47,183 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-11 22:54:47,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-11 22:54:47,183 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:47,183 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 22:54:47,183 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-03-11 22:54:47,183 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-03-11 22:54:47,183 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase20.apache.org,41843,1678575183185' in zk 2023-03-11 22:54:47,184 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-03-11 22:54:47,185 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:54:47,185 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-03-11 22:54:47,185 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:47,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:47,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:54:47,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:54:47,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:54:47,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:54:47,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-11 22:54:47,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:47,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:54:47,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-11 22:54:47,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:47,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase20.apache.org,41843,1678575183185': 2023-03-11 22:54:47,187 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-03-11 22:54:47,187 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-03-11 22:54:47,187 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 22:54:47,187 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 22:54:47,187 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-03-11 22:54:47,187 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 22:54:47,188 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-11 22:54:47,188 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-11 22:54:47,188 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-11 22:54:47,188 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:54:47,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-11 22:54:47,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-11 22:54:47,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:54:47,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:54:47,189 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:54:47,189 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:47,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:54:47,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:54:47,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-11 22:54:47,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-11 22:54:47,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:54:47,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-11 22:54:47,190 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:47,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:47,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:54:47,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-11 22:54:47,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:47,192 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:47,192 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:54:47,192 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-11 22:54:47,192 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:54:47,192 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-03-11 22:54:47,192 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 22:54:47,192 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-03-11 22:54:47,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:54:47,192 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:54:47,192 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-11 22:54:47,192 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:54:47,192 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:47,192 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-03-11 22:54:47,192 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:54:47,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:54:47,192 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-11 22:54:47,192 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 22:54:47,192 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-11 22:54:47,193 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-11 22:54:47,293 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 22:54:47,295 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 22:54:47,297 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1678575280100.f5ff2dc2c8d65f11f0ecb2681def8a43. with WAL disabled. Data may be lost in the event of a crash. 2023-03-11 22:54:47,298 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1678575280100.c9557b829346f7133c6ea3c6c1b42236. with WAL disabled. Data may be lost in the event of a crash. 2023-03-11 22:54:47,298 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1678575280100.7189059ae0acaaffd2a7e63414af38f7. with WAL disabled. Data may be lost in the event of a crash. 2023-03-11 22:54:47,305 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-11 22:54:47,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-03-11 22:54:47,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-03-11 22:54:47,307 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-03-11 22:54:47,307 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:54:47,307 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-03-11 22:54:47,307 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-03-11 22:54:47,307 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-11 22:54:47,307 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-11 22:54:47,308 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:47,308 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:54:47,308 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:54:47,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:54:47,308 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:47,308 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 22:54:47,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-11 22:54:47,309 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-11 22:54:47,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 22:54:47,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-11 22:54:47,309 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-03-11 22:54:47,309 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-03-11 22:54:47,309 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-03-11 22:54:47,309 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-03-11 22:54:47,309 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:54:47,309 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-03-11 22:54:47,310 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1678575280100.7189059ae0acaaffd2a7e63414af38f7. 2023-03-11 22:54:47,310 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1678575280100.f5ff2dc2c8d65f11f0ecb2681def8a43. 2023-03-11 22:54:47,310 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1678575280100.7189059ae0acaaffd2a7e63414af38f7. started... 2023-03-11 22:54:47,310 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-11 22:54:47,310 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 22:54:47,310 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1678575280100.c9557b829346f7133c6ea3c6c1b42236. 2023-03-11 22:54:47,310 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1678575280100.c9557b829346f7133c6ea3c6c1b42236. started... 2023-03-11 22:54:47,310 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1678575280100.f5ff2dc2c8d65f11f0ecb2681def8a43. started... 2023-03-11 22:54:47,310 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 7189059ae0acaaffd2a7e63414af38f7 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-03-11 22:54:47,310 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing f5ff2dc2c8d65f11f0ecb2681def8a43 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-03-11 22:54:47,310 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing c9557b829346f7133c6ea3c6c1b42236 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-03-11 22:54:47,731 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230311a27e4a83b27c4b30b2875268932f5f96 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230311a27e4a83b27c4b30b2875268932f5f96 2023-03-11 22:54:47,731 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230311e5edfb7e86044da99c8e8fc0b0d075d5 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230311e5edfb7e86044da99c8e8fc0b0d075d5 2023-03-11 22:54:47,732 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230311f3e1642b0eae497e8943343bd9127843 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230311f3e1642b0eae497e8943343bd9127843 2023-03-11 22:54:48,143 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/.tmp/family1/d4a76178692149918ee59f0c53bd768e 2023-03-11 22:54:48,144 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/.tmp/family1/7da2cf4d34844cb08bfda2f1981a5aa3 2023-03-11 22:54:48,144 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/.tmp/family1/043642cf5ff64bcfbb11167818921f2a 2023-03-11 22:54:48,575 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023031120f2f8b5571042b2847c9bc8db048105 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023031120f2f8b5571042b2847c9bc8db048105 2023-03-11 22:54:48,577 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230311ed610082841a44f4a2bf291974d056cb to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230311ed610082841a44f4a2bf291974d056cb 2023-03-11 22:54:48,577 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202303111592aab81cfb4f39a69a641c21ccc611 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202303111592aab81cfb4f39a69a641c21ccc611 2023-03-11 22:54:48,982 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/.tmp/family2/75664672bae7473c96efa0a98a865614 2023-03-11 22:54:48,983 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/.tmp/family2/03ba98a6910540ec9e47b184aac49932 2023-03-11 22:54:48,987 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/.tmp/family2/3968f87f78914e98a705a9c15c526df6 2023-03-11 22:54:48,992 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/.tmp/family1/d4a76178692149918ee59f0c53bd768e as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family1/d4a76178692149918ee59f0c53bd768e 2023-03-11 22:54:48,993 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/.tmp/family1/043642cf5ff64bcfbb11167818921f2a as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family1/043642cf5ff64bcfbb11167818921f2a 2023-03-11 22:54:48,994 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/.tmp/family1/7da2cf4d34844cb08bfda2f1981a5aa3 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family1/7da2cf4d34844cb08bfda2f1981a5aa3 2023-03-11 22:54:48,997 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family1/043642cf5ff64bcfbb11167818921f2a, entries=4, sequenceid=17, filesize=5.4 K 2023-03-11 22:54:48,997 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family1/d4a76178692149918ee59f0c53bd768e, entries=4, sequenceid=17, filesize=5.4 K 2023-03-11 22:54:48,998 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/.tmp/family2/75664672bae7473c96efa0a98a865614 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family2/75664672bae7473c96efa0a98a865614 2023-03-11 22:54:48,998 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/.tmp/family2/03ba98a6910540ec9e47b184aac49932 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family2/03ba98a6910540ec9e47b184aac49932 2023-03-11 22:54:48,999 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family1/7da2cf4d34844cb08bfda2f1981a5aa3, entries=4, sequenceid=17, filesize=5.4 K 2023-03-11 22:54:48,999 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/.tmp/family2/3968f87f78914e98a705a9c15c526df6 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family2/3968f87f78914e98a705a9c15c526df6 2023-03-11 22:54:49,003 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family2/03ba98a6910540ec9e47b184aac49932, entries=2, sequenceid=17, filesize=5.1 K 2023-03-11 22:54:49,003 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family2/75664672bae7473c96efa0a98a865614, entries=2, sequenceid=17, filesize=5.1 K 2023-03-11 22:54:49,003 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for c9557b829346f7133c6ea3c6c1b42236 in 1693ms, sequenceid=17, compaction requested=true 2023-03-11 22:54:49,003 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 7189059ae0acaaffd2a7e63414af38f7 in 1693ms, sequenceid=17, compaction requested=true 2023-03-11 22:54:49,003 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for c9557b829346f7133c6ea3c6c1b42236: 2023-03-11 22:54:49,004 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7189059ae0acaaffd2a7e63414af38f7: 2023-03-11 22:54:49,004 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1678575280100.c9557b829346f7133c6ea3c6c1b42236. 2023-03-11 22:54:49,003 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family2/3968f87f78914e98a705a9c15c526df6, entries=2, sequenceid=17, filesize=5.1 K 2023-03-11 22:54:49,004 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-11 22:54:49,004 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1678575280100.7189059ae0acaaffd2a7e63414af38f7. 2023-03-11 22:54:49,004 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-11 22:54:49,004 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for f5ff2dc2c8d65f11f0ecb2681def8a43 in 1694ms, sequenceid=17, compaction requested=true 2023-03-11 22:54:49,004 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for f5ff2dc2c8d65f11f0ecb2681def8a43: 2023-03-11 22:54:49,004 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1678575280100.f5ff2dc2c8d65f11f0ecb2681def8a43. 2023-03-11 22:54:49,004 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-11 22:54:49,004 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-11 22:54:49,004 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:49,004 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-03-11 22:54:49,004 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-03-11 22:54:49,005 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-11 22:54:49,005 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:49,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:49,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:54:49,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:54:49,005 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-11 22:54:49,005 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 22:54:49,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:54:49,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:54:49,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-11 22:54:49,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:49,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:54:49,006 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-03-11 22:54:49,006 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@597164b[Count = 0] remaining members to acquire global barrier 2023-03-11 22:54:49,006 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-03-11 22:54:49,006 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-11 22:54:49,007 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-11 22:54:49,007 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-11 22:54:49,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-11 22:54:49,007 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-03-11 22:54:49,007 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-03-11 22:54:49,007 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:49,007 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 22:54:49,007 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase20.apache.org,41843,1678575183185' in zk 2023-03-11 22:54:49,008 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-03-11 22:54:49,008 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:49,008 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:54:49,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:49,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:54:49,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:54:49,008 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-03-11 22:54:49,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:54:49,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:54:49,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-11 22:54:49,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:49,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:54:49,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-11 22:54:49,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:49,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase20.apache.org,41843,1678575183185': 2023-03-11 22:54:49,009 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-03-11 22:54:49,009 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 22:54:49,009 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 22:54:49,009 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-03-11 22:54:49,009 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-03-11 22:54:49,009 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 22:54:49,010 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-11 22:54:49,010 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-11 22:54:49,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-11 22:54:49,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:54:49,010 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-11 22:54:49,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-11 22:54:49,010 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:54:49,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:54:49,010 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:49,010 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:54:49,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:54:49,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:54:49,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-11 22:54:49,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-11 22:54:49,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:54:49,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-11 22:54:49,011 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:49,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:49,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:54:49,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-11 22:54:49,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:49,012 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:49,012 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:54:49,012 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-11 22:54:49,012 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:54:49,012 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-03-11 22:54:49,012 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-03-11 22:54:49,012 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 22:54:49,012 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-11 22:54:49,012 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:54:49,012 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:54:49,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:54:49,013 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:49,013 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-03-11 22:54:49,013 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-11 22:54:49,013 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 22:54:49,013 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:54:49,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:54:49,013 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-11 22:54:49,013 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-11 22:54:49,113 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 22:54:49,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 22:54:49,130 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1580): Client=jenkins//148.251.75.209 snapshot request for:{ ss=snaptb-1678575289115 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-03-11 22:54:49,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1678575289130 (current time:1678575289130). 2023-03-11 22:54:49,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-03-11 22:54:49,131 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] zookeeper.ReadOnlyZKClient(139): Connect 0x2a8d9576 to 127.0.0.1:51815 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-11 22:54:49,135 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@53cdf240, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-11 22:54:49,139 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-11 22:54:49,142 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:37300, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-11 22:54:49,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2a8d9576 to 127.0.0.1:51815 2023-03-11 22:54:49,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-11 22:54:49,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-03-11 22:54:49,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb-1678575289115 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-03-11 22:54:49,153 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure2.ProcedureExecutor(1029): Stored pid=86, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-03-11 22:54:49,154 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=86, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-03-11 22:54:49,155 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=86, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE; timeout=600000, timestamp=1678575889155 2023-03-11 22:54:49,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb-1678575289115 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-03-11 22:54:49,155 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb-1678575289115 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink 2023-03-11 22:54:49,156 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=86, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-03-11 22:54:49,157 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1029): Stored pid=87, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-03-11 22:54:49,157 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=86, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE in 3 msec 2023-03-11 22:54:49,158 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=87, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-03-11 22:54:49,158 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=87, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED; timeout=600000, timestamp=1678575889158 2023-03-11 22:54:49,160 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb-1678575289115 table=testCompactionWithHFileLink type=FLUSH ttl=0 }'' to complete. (max 300000 ms per retry) 2023-03-11 22:54:49,160 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-03-11 22:54:49,260 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-11 22:54:49,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1678575289115 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-11 22:54:49,265 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1678575289115 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-03-11 22:54:49,265 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-03-11 22:54:49,466 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-11 22:54:49,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1678575289115 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-11 22:54:49,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1678575289115 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-03-11 22:54:49,467 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-03-11 22:54:49,567 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb-1678575289115 2023-03-11 22:54:49,567 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb-1678575289115' 2023-03-11 22:54:49,568 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-03-11 22:54:49,568 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb-1678575289115' starting 'acquire' 2023-03-11 22:54:49,568 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb-1678575289115', kicking off acquire phase on members. 2023-03-11 22:54:49,568 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb-1678575289115 2023-03-11 22:54:49,568 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb-1678575289115 2023-03-11 22:54:49,569 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-03-11 22:54:49,569 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb-1678575289115/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:49,569 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-03-11 22:54:49,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-03-11 22:54:49,569 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb-1678575289115/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:49,569 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 22:54:49,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb-1678575289115 2023-03-11 22:54:49,570 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb-1678575289115 2023-03-11 22:54:49,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-03-11 22:54:49,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb-1678575289115 2023-03-11 22:54:49,570 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb-1678575289115 from table testCompactionWithHFileLink type FLUSH 2023-03-11 22:54:49,572 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb-1678575289115 2023-03-11 22:54:49,572 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb-1678575289115' with timeout 300000ms 2023-03-11 22:54:49,572 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-03-11 22:54:49,572 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb-1678575289115' starting 'acquire' stage 2023-03-11 22:54:49,572 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb-1678575289115' locally acquired 2023-03-11 22:54:49,572 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure (snaptb-1678575289115) in zk 2023-03-11 22:54:49,573 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb-1678575289115 2023-03-11 22:54:49,573 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1678575289115/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:49,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb-1678575289115/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:49,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:54:49,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-03-11 22:54:49,574 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb-1678575289115 2023-03-11 22:54:49,574 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb-1678575289115' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 22:54:49,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:54:49,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:54:49,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1678575289115 2023-03-11 22:54:49,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:49,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:54:49,575 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure 'snaptb-1678575289115' on coordinator 2023-03-11 22:54:49,575 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@24adecb3[Count = 0] remaining members to acquire global barrier 2023-03-11 22:54:49,575 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb-1678575289115' starting 'in-barrier' execution. 2023-03-11 22:54:49,575 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb-1678575289115 2023-03-11 22:54:49,576 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1678575289115 2023-03-11 22:54:49,576 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb-1678575289115 2023-03-11 22:54:49,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb-1678575289115 2023-03-11 22:54:49,576 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb-1678575289115' received 'reached' from coordinator. 2023-03-11 22:54:49,576 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb-1678575289115/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:49,576 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 22:54:49,577 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,2,1678575280100.7189059ae0acaaffd2a7e63414af38f7. 2023-03-11 22:54:49,577 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,,1678575280100.f5ff2dc2c8d65f11f0ecb2681def8a43. 2023-03-11 22:54:49,577 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,1,1678575280100.c9557b829346f7133c6ea3c6c1b42236. 2023-03-11 22:54:49,577 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 3 regions 2023-03-11 22:54:49,577 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-03-11 22:54:49,577 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,1,1678575280100.c9557b829346f7133c6ea3c6c1b42236. started... 2023-03-11 22:54:49,577 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,,1678575280100.f5ff2dc2c8d65f11f0ecb2681def8a43. started... 2023-03-11 22:54:49,577 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,2,1678575280100.7189059ae0acaaffd2a7e63414af38f7. started... 2023-03-11 22:54:49,578 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-snapshot-pool-2] regionserver.HRegion(2446): Flush status journal for c9557b829346f7133c6ea3c6c1b42236: 2023-03-11 22:54:49,578 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 7189059ae0acaaffd2a7e63414af38f7: 2023-03-11 22:54:49,578 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-snapshot-pool-1] regionserver.HRegion(2446): Flush status journal for f5ff2dc2c8d65f11f0ecb2681def8a43: 2023-03-11 22:54:49,578 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,,1678575280100.f5ff2dc2c8d65f11f0ecb2681def8a43.' region-info for snapshot=snaptb-1678575289115 2023-03-11 22:54:49,578 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,2,1678575280100.7189059ae0acaaffd2a7e63414af38f7.' region-info for snapshot=snaptb-1678575289115 2023-03-11 22:54:49,578 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,1,1678575280100.c9557b829346f7133c6ea3c6c1b42236.' region-info for snapshot=snaptb-1678575289115 2023-03-11 22:54:49,584 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-03-11 22:54:49,584 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-03-11 22:54:49,584 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-03-11 22:54:49,588 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family1/b71bc618951c43e69e774b42be4b0bef, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family1/6dcf1deb771d4f1684637d7e9f23839d, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family1/a2c8cd3ba10746a5857f359843a355cb, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family1/7da2cf4d34844cb08bfda2f1981a5aa3] hfiles 2023-03-11 22:54:49,588 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family1/de777f4aa41a4d8fb92468da0d003d99, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family1/501392378a5d499b90c1edfbc30e4277, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family1/18bc795cc708409888f506cea46a1ceb, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family1/d4a76178692149918ee59f0c53bd768e] hfiles 2023-03-11 22:54:49,588 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family1/bd42d7e392e844e2a435e9965bbe4b52, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family1/792b51b4e7344f2bb05423e36d8dccac, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family1/70a13ebdab6744bb8dd47dd67237f4ca, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family1/043642cf5ff64bcfbb11167818921f2a] hfiles 2023-03-11 22:54:49,589 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family1/bd42d7e392e844e2a435e9965bbe4b52 for snapshot=snaptb-1678575289115 2023-03-11 22:54:49,589 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family1/de777f4aa41a4d8fb92468da0d003d99 for snapshot=snaptb-1678575289115 2023-03-11 22:54:49,589 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family1/b71bc618951c43e69e774b42be4b0bef for snapshot=snaptb-1678575289115 2023-03-11 22:54:49,591 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family1/792b51b4e7344f2bb05423e36d8dccac for snapshot=snaptb-1678575289115 2023-03-11 22:54:49,591 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family1/70a13ebdab6744bb8dd47dd67237f4ca for snapshot=snaptb-1678575289115 2023-03-11 22:54:49,591 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family1/043642cf5ff64bcfbb11167818921f2a for snapshot=snaptb-1678575289115 2023-03-11 22:54:49,591 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family1/501392378a5d499b90c1edfbc30e4277 for snapshot=snaptb-1678575289115 2023-03-11 22:54:49,591 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family1/6dcf1deb771d4f1684637d7e9f23839d for snapshot=snaptb-1678575289115 2023-03-11 22:54:49,591 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family1/a2c8cd3ba10746a5857f359843a355cb for snapshot=snaptb-1678575289115 2023-03-11 22:54:49,592 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family1/7da2cf4d34844cb08bfda2f1981a5aa3 for snapshot=snaptb-1678575289115 2023-03-11 22:54:49,591 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family2/85d83795bb82460c9e80c58c7c9ee030, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family2/22a1925811b2401c869aa7abba4e22f2, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family2/55033e843476407d82f5c58e2a278d03, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family2/75664672bae7473c96efa0a98a865614] hfiles 2023-03-11 22:54:49,592 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family2/85d83795bb82460c9e80c58c7c9ee030 for snapshot=snaptb-1678575289115 2023-03-11 22:54:49,592 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family2/22a1925811b2401c869aa7abba4e22f2 for snapshot=snaptb-1678575289115 2023-03-11 22:54:49,591 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family1/18bc795cc708409888f506cea46a1ceb for snapshot=snaptb-1678575289115 2023-03-11 22:54:49,592 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family1/d4a76178692149918ee59f0c53bd768e for snapshot=snaptb-1678575289115 2023-03-11 22:54:49,592 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family2/55033e843476407d82f5c58e2a278d03 for snapshot=snaptb-1678575289115 2023-03-11 22:54:49,592 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family2/75664672bae7473c96efa0a98a865614 for snapshot=snaptb-1678575289115 2023-03-11 22:54:49,592 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family2/56a3feebc66c4f1b84e6eae2fe9cef71, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family2/9811e2f543154038a3c389b2b7bae676, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family2/79ebb06592894586af3575e3868c1041, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family2/3968f87f78914e98a705a9c15c526df6] hfiles 2023-03-11 22:54:49,592 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family2/56a3feebc66c4f1b84e6eae2fe9cef71 for snapshot=snaptb-1678575289115 2023-03-11 22:54:49,592 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family2/f0aea611a01547acbf71afe50f36b56e, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family2/08c74fbf215e40af9afa551a84198fdc, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family2/f8c70657fdc84511b043d1760c4a13b4, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family2/03ba98a6910540ec9e47b184aac49932] hfiles 2023-03-11 22:54:49,592 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family2/f0aea611a01547acbf71afe50f36b56e for snapshot=snaptb-1678575289115 2023-03-11 22:54:49,592 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family2/08c74fbf215e40af9afa551a84198fdc for snapshot=snaptb-1678575289115 2023-03-11 22:54:49,592 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family2/f8c70657fdc84511b043d1760c4a13b4 for snapshot=snaptb-1678575289115 2023-03-11 22:54:49,592 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family2/03ba98a6910540ec9e47b184aac49932 for snapshot=snaptb-1678575289115 2023-03-11 22:54:49,592 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family2/9811e2f543154038a3c389b2b7bae676 for snapshot=snaptb-1678575289115 2023-03-11 22:54:49,592 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family2/79ebb06592894586af3575e3868c1041 for snapshot=snaptb-1678575289115 2023-03-11 22:54:49,592 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family2/3968f87f78914e98a705a9c15c526df6 for snapshot=snaptb-1678575289115 2023-03-11 22:54:49,710 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-11 22:54:49,710 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5c92e484 to 127.0.0.1:51815 2023-03-11 22:54:49,711 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-11 22:54:49,711 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x370570d0 to 127.0.0.1:51815 2023-03-11 22:54:49,711 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-11 22:54:49,711 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-11 22:54:49,711 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5e66fa64 to 127.0.0.1:51815 2023-03-11 22:54:49,711 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-11 22:54:49,711 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-11 22:54:49,712 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x594caab1 to 127.0.0.1:51815 2023-03-11 22:54:49,712 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-11 22:54:49,768 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-11 22:54:49,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1678575289115 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-11 22:54:49,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1678575289115 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-03-11 22:54:49,769 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-03-11 22:54:50,128 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,,1678575280100.f5ff2dc2c8d65f11f0ecb2681def8a43. completed. 2023-03-11 22:54:50,129 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,,1678575280100.f5ff2dc2c8d65f11f0ecb2681def8a43. 2023-03-11 22:54:50,129 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,2,1678575280100.7189059ae0acaaffd2a7e63414af38f7. completed. 2023-03-11 22:54:50,129 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,2,1678575280100.7189059ae0acaaffd2a7e63414af38f7. 2023-03-11 22:54:50,129 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,1,1678575280100.c9557b829346f7133c6ea3c6c1b42236. completed. 2023-03-11 22:54:50,129 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,1,1678575280100.c9557b829346f7133c6ea3c6c1b42236. 2023-03-11 22:54:50,130 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/3 local region snapshots. 2023-03-11 22:54:50,130 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/3 local region snapshots. 2023-03-11 22:54:50,130 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/3 local region snapshots. 2023-03-11 22:54:50,130 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 3 local region snapshots. 2023-03-11 22:54:50,130 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:50,130 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb-1678575289115' locally completed 2023-03-11 22:54:50,131 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb-1678575289115' completed for member 'jenkins-hbase20.apache.org,41843,1678575183185' in zk 2023-03-11 22:54:50,133 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb-1678575289115' has notified controller of completion 2023-03-11 22:54:50,134 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1678575289115/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:50,134 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:54:50,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb-1678575289115/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:50,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:54:50,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-03-11 22:54:50,134 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb-1678575289115' completed. 2023-03-11 22:54:50,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:54:50,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:54:50,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1678575289115 2023-03-11 22:54:50,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:50,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:54:50,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1678575289115 2023-03-11 22:54:50,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:50,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb-1678575289115' member 'jenkins-hbase20.apache.org,41843,1678575183185': 2023-03-11 22:54:50,142 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' released barrier for procedure'snaptb-1678575289115', counting down latch. Waiting for 0 more 2023-03-11 22:54:50,142 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb-1678575289115' execution completed 2023-03-11 22:54:50,142 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 22:54:50,142 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 22:54:50,142 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb-1678575289115 2023-03-11 22:54:50,142 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb-1678575289115including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-03-11 22:54:50,145 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1678575289115 2023-03-11 22:54:50,145 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1678575289115 2023-03-11 22:54:50,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb-1678575289115 2023-03-11 22:54:50,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:54:50,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-03-11 22:54:50,145 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb-1678575289115 2023-03-11 22:54:50,145 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-03-11 22:54:50,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb-1678575289115 2023-03-11 22:54:50,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:54:50,146 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb-1678575289115/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:50,146 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-03-11 22:54:50,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-03-11 22:54:50,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1678575289115 2023-03-11 22:54:50,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb-1678575289115 2023-03-11 22:54:50,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:54:50,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1678575289115 2023-03-11 22:54:50,148 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb-1678575289115/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:50,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:50,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:54:50,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1678575289115 2023-03-11 22:54:50,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:50,151 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1678575289115/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:50,151 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-03-11 22:54:50,151 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:54:50,151 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-03-11 22:54:50,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-03-11 22:54:50,151 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1678575289115 2023-03-11 22:54:50,151 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb-1678575289115 2023-03-11 22:54:50,151 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-03-11 22:54:50,152 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testCompactionWithHFileLink 2023-03-11 22:54:50,152 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb-1678575289115 because node does not exist (not an error) 2023-03-11 22:54:50,152 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1678575289115 2023-03-11 22:54:50,152 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 0e7b6fa9e81bd62588edd7d77d6165e4, NAME => 'testCompactionWithHFileLink,.mob,0.0e7b6fa9e81bd62588edd7d77d6165e4.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb-1678575289115 2023-03-11 22:54:50,152 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-03-11 22:54:50,152 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1678575289115/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:50,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-03-11 22:54:50,152 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-03-11 22:54:50,152 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1678575289115 2023-03-11 22:54:50,152 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1678575289115 2023-03-11 22:54:50,152 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1678575289115 2023-03-11 22:54:50,154 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202303118527fef18c5e485c949f1cd3a30c3aaa, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230311a27e4a83b27c4b30b2875268932f5f96, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230311d39059d225114219bb95e51a3bf73129, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230311ecd72b1e22a74ca4941b5e1642c89708, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202303112d52c5edbd894361b1998c4735e4a082, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202303117cac817e46b249e58838f77e044220eb, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202303119e2f565be17f40a48d173fb84aee091c, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230311e5edfb7e86044da99c8e8fc0b0d075d5, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202303113fc32ad601054ce383d790ba61e9b1d9, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202303119f211bc34e194a71bf189bd5baf45037, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230311eadcedaacb5d4629984edc323cb2ca58, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230311f3e1642b0eae497e8943343bd9127843] mob files 2023-03-11 22:54:50,154 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/12): hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202303118527fef18c5e485c949f1cd3a30c3aaa 2023-03-11 22:54:50,154 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/12): hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230311a27e4a83b27c4b30b2875268932f5f96 2023-03-11 22:54:50,154 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (3/12): hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230311d39059d225114219bb95e51a3bf73129 2023-03-11 22:54:50,154 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (4/12): hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230311ecd72b1e22a74ca4941b5e1642c89708 2023-03-11 22:54:50,154 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (5/12): hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202303112d52c5edbd894361b1998c4735e4a082 2023-03-11 22:54:50,154 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (6/12): hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202303117cac817e46b249e58838f77e044220eb 2023-03-11 22:54:50,154 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (7/12): hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202303119e2f565be17f40a48d173fb84aee091c 2023-03-11 22:54:50,154 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (8/12): hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230311e5edfb7e86044da99c8e8fc0b0d075d5 2023-03-11 22:54:50,155 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (9/12): hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202303113fc32ad601054ce383d790ba61e9b1d9 2023-03-11 22:54:50,155 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (10/12): hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202303119f211bc34e194a71bf189bd5baf45037 2023-03-11 22:54:50,155 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (11/12): hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230311eadcedaacb5d4629984edc323cb2ca58 2023-03-11 22:54:50,155 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (12/12): hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230311f3e1642b0eae497e8943343bd9127843 2023-03-11 22:54:50,156 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202303111592aab81cfb4f39a69a641c21ccc611, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202303112e82ff8048a34eeca5e178fe8ced73eb, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202303113e6629ce680c49dea38070747438fc75, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230311ab679c8580b747129707b59c422a1364, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202303111fb665807e7c4ca1ae12fef6db1004d4, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023031120f2f8b5571042b2847c9bc8db048105, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202303113056fe9b988046309ed8e7ae7ceb4086, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230311559d25fc53c04f738cdf9dcbd65a3dba, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202303118e7d78be23434c5fb4fc0045235c5514, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230311a5761f8506244c52b5425d6325f21461, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230311bd6add52e77a495cb451a1c9ec966c72, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230311ed610082841a44f4a2bf291974d056cb] mob files 2023-03-11 22:54:50,156 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/12): hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202303111592aab81cfb4f39a69a641c21ccc611 2023-03-11 22:54:50,156 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/12): hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202303112e82ff8048a34eeca5e178fe8ced73eb 2023-03-11 22:54:50,156 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (3/12): hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202303113e6629ce680c49dea38070747438fc75 2023-03-11 22:54:50,156 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (4/12): hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230311ab679c8580b747129707b59c422a1364 2023-03-11 22:54:50,156 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (5/12): hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202303111fb665807e7c4ca1ae12fef6db1004d4 2023-03-11 22:54:50,156 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (6/12): hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023031120f2f8b5571042b2847c9bc8db048105 2023-03-11 22:54:50,156 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (7/12): hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202303113056fe9b988046309ed8e7ae7ceb4086 2023-03-11 22:54:50,156 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (8/12): hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230311559d25fc53c04f738cdf9dcbd65a3dba 2023-03-11 22:54:50,156 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (9/12): hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202303118e7d78be23434c5fb4fc0045235c5514 2023-03-11 22:54:50,156 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (10/12): hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230311a5761f8506244c52b5425d6325f21461 2023-03-11 22:54:50,156 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (11/12): hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230311bd6add52e77a495cb451a1c9ec966c72 2023-03-11 22:54:50,156 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (12/12): hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230311ed610082841a44f4a2bf291974d056cb 2023-03-11 22:54:50,269 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-11 22:54:50,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1678575289115 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-11 22:54:50,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1678575289115 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-03-11 22:54:50,271 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-03-11 22:54:50,563 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb-1678575289115 2023-03-11 22:54:50,568 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/.hbase-snapshot/.tmp/snaptb-1678575289115 2023-03-11 22:54:51,019 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/.hbase-snapshot/.tmp/snaptb-1678575289115 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/.hbase-snapshot/snaptb-1678575289115 2023-03-11 22:54:51,271 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-11 22:54:51,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1678575289115 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-11 22:54:51,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1678575289115 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-03-11 22:54:51,272 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2428): (#6) Sleeping: 2000ms while waiting for snapshot completion. 2023-03-11 22:54:51,435 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb-1678575289115 of table testCompactionWithHFileLink completed 2023-03-11 22:54:51,435 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/.hbase-snapshot/.tmp/snaptb-1678575289115 2023-03-11 22:54:51,436 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/.hbase-snapshot/.tmp/snaptb-1678575289115 2023-03-11 22:54:51,436 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb-1678575289115 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink at 1678575289155Completed referencing HFiles for the mob region of table: testCompactionWithHFileLink at 1678575290563 (+1408 ms)Consolidate snapshot: snaptb-1678575289115 at 1678575290563Loading Region manifests for snaptb-1678575289115 at 1678575290564 (+1 ms)Writing data manifest for snaptb-1678575289115 at 1678575290582 (+18 ms)Verifying snapshot: snaptb-1678575289115 at 1678575290994 (+412 ms)Snapshot snaptb-1678575289115 of table testCompactionWithHFileLink completed at 1678575291435 (+441 ms) 2023-03-11 22:54:51,437 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=87, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-03-11 22:54:51,439 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=87, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED in 2.2810 sec 2023-03-11 22:54:53,272 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-11 22:54:53,273 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1678575289115 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-11 22:54:53,273 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb-1678575289115 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' has completed, notifying client. 2023-03-11 22:54:53,308 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-11 22:54:53,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-03-11 22:54:53,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-03-11 22:54:53,314 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-03-11 22:54:53,314 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:54:53,314 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-03-11 22:54:53,314 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-03-11 22:54:53,314 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-11 22:54:53,314 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-11 22:54:53,315 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:54:53,315 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:53,315 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:54:53,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:54:53,315 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:53,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-11 22:54:53,315 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 22:54:53,315 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-11 22:54:53,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 22:54:53,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-11 22:54:53,316 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-03-11 22:54:53,316 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-03-11 22:54:53,316 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-03-11 22:54:53,316 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:54:53,316 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-03-11 22:54:53,316 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1678575280100.7189059ae0acaaffd2a7e63414af38f7. 2023-03-11 22:54:53,316 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1678575280100.7189059ae0acaaffd2a7e63414af38f7. started... 2023-03-11 22:54:53,316 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-11 22:54:53,316 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1678575280100.c9557b829346f7133c6ea3c6c1b42236. 2023-03-11 22:54:53,316 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1678575280100.f5ff2dc2c8d65f11f0ecb2681def8a43. 2023-03-11 22:54:53,316 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1678575280100.c9557b829346f7133c6ea3c6c1b42236. started... 2023-03-11 22:54:53,316 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 7189059ae0acaaffd2a7e63414af38f7 2/2 column families, dataSize=138 B heapSize=944 B 2023-03-11 22:54:53,316 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 22:54:53,316 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing c9557b829346f7133c6ea3c6c1b42236 2/2 column families, dataSize=138 B heapSize=944 B 2023-03-11 22:54:53,316 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1678575280100.f5ff2dc2c8d65f11f0ecb2681def8a43. started... 2023-03-11 22:54:53,317 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing f5ff2dc2c8d65f11f0ecb2681def8a43 2/2 column families, dataSize=138 B heapSize=944 B 2023-03-11 22:54:53,756 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/.tmp/family1/d84f132011a640259b0b91b530a99d80 2023-03-11 22:54:53,760 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d84f132011a640259b0b91b530a99d80 2023-03-11 22:54:53,761 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/.tmp/family1/4b0ad1a39dbb40dab16f4dc8e4341fad 2023-03-11 22:54:53,767 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4b0ad1a39dbb40dab16f4dc8e4341fad 2023-03-11 22:54:54,144 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/.tmp/family1/58c51195aea74495b6f805b0f5ec226b 2023-03-11 22:54:54,151 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 58c51195aea74495b6f805b0f5ec226b 2023-03-11 22:54:54,182 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/.tmp/family2/351861d1830a4fb7883bfff7135d3f5e 2023-03-11 22:54:54,186 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 351861d1830a4fb7883bfff7135d3f5e 2023-03-11 22:54:54,187 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/.tmp/family1/d84f132011a640259b0b91b530a99d80 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family1/d84f132011a640259b0b91b530a99d80 2023-03-11 22:54:54,190 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d84f132011a640259b0b91b530a99d80 2023-03-11 22:54:54,190 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family1/d84f132011a640259b0b91b530a99d80, entries=3, sequenceid=24, filesize=5.0 K 2023-03-11 22:54:54,195 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/.tmp/family2/351861d1830a4fb7883bfff7135d3f5e as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family2/351861d1830a4fb7883bfff7135d3f5e 2023-03-11 22:54:54,199 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 351861d1830a4fb7883bfff7135d3f5e 2023-03-11 22:54:54,200 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family2/351861d1830a4fb7883bfff7135d3f5e, entries=1, sequenceid=24, filesize=5.0 K 2023-03-11 22:54:54,201 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for f5ff2dc2c8d65f11f0ecb2681def8a43 in 884ms, sequenceid=24, compaction requested=true 2023-03-11 22:54:54,201 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for f5ff2dc2c8d65f11f0ecb2681def8a43: 2023-03-11 22:54:54,201 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1678575280100.f5ff2dc2c8d65f11f0ecb2681def8a43. 2023-03-11 22:54:54,201 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-11 22:54:54,587 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/.tmp/family2/4f41ef71a89d44a3a1aa87992e33d9e8 2023-03-11 22:54:54,591 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4f41ef71a89d44a3a1aa87992e33d9e8 2023-03-11 22:54:54,592 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/.tmp/family1/4b0ad1a39dbb40dab16f4dc8e4341fad as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family1/4b0ad1a39dbb40dab16f4dc8e4341fad 2023-03-11 22:54:54,596 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4b0ad1a39dbb40dab16f4dc8e4341fad 2023-03-11 22:54:54,596 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family1/4b0ad1a39dbb40dab16f4dc8e4341fad, entries=3, sequenceid=24, filesize=5.0 K 2023-03-11 22:54:54,597 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/.tmp/family2/4f41ef71a89d44a3a1aa87992e33d9e8 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family2/4f41ef71a89d44a3a1aa87992e33d9e8 2023-03-11 22:54:54,601 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4f41ef71a89d44a3a1aa87992e33d9e8 2023-03-11 22:54:54,601 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family2/4f41ef71a89d44a3a1aa87992e33d9e8, entries=1, sequenceid=24, filesize=5.0 K 2023-03-11 22:54:54,602 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for c9557b829346f7133c6ea3c6c1b42236 in 1286ms, sequenceid=24, compaction requested=true 2023-03-11 22:54:54,602 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for c9557b829346f7133c6ea3c6c1b42236: 2023-03-11 22:54:54,602 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1678575280100.c9557b829346f7133c6ea3c6c1b42236. 2023-03-11 22:54:54,602 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-11 22:54:54,969 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/.tmp/family2/85880796b68342158247644454216ce8 2023-03-11 22:54:54,973 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 85880796b68342158247644454216ce8 2023-03-11 22:54:54,974 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/.tmp/family1/58c51195aea74495b6f805b0f5ec226b as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family1/58c51195aea74495b6f805b0f5ec226b 2023-03-11 22:54:54,977 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 58c51195aea74495b6f805b0f5ec226b 2023-03-11 22:54:54,978 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family1/58c51195aea74495b6f805b0f5ec226b, entries=3, sequenceid=24, filesize=5.0 K 2023-03-11 22:54:54,978 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/.tmp/family2/85880796b68342158247644454216ce8 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family2/85880796b68342158247644454216ce8 2023-03-11 22:54:54,982 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 85880796b68342158247644454216ce8 2023-03-11 22:54:54,982 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family2/85880796b68342158247644454216ce8, entries=1, sequenceid=24, filesize=5.0 K 2023-03-11 22:54:54,983 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 7189059ae0acaaffd2a7e63414af38f7 in 1667ms, sequenceid=24, compaction requested=true 2023-03-11 22:54:54,983 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7189059ae0acaaffd2a7e63414af38f7: 2023-03-11 22:54:54,983 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1678575280100.7189059ae0acaaffd2a7e63414af38f7. 2023-03-11 22:54:54,983 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-11 22:54:54,983 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-11 22:54:54,983 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:54,983 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-03-11 22:54:54,983 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-03-11 22:54:54,986 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-11 22:54:54,986 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:54,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:54,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:54:54,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:54:54,986 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-11 22:54:54,986 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 22:54:54,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:54:54,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:54:54,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-11 22:54:54,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:54,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:54:54,987 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-03-11 22:54:54,987 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-03-11 22:54:54,987 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7adebef[Count = 0] remaining members to acquire global barrier 2023-03-11 22:54:54,987 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-11 22:54:54,988 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-11 22:54:54,988 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-11 22:54:54,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-11 22:54:54,988 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-03-11 22:54:54,988 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-03-11 22:54:54,988 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:54,988 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 22:54:54,988 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase20.apache.org,41843,1678575183185' in zk 2023-03-11 22:54:54,989 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:54,989 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-03-11 22:54:54,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:54,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:54:54,989 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:54:54,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:54:54,989 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-03-11 22:54:54,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:54:54,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:54:54,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-11 22:54:54,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:54,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:54:54,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-11 22:54:54,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:54,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase20.apache.org,41843,1678575183185': 2023-03-11 22:54:54,991 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-03-11 22:54:54,991 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-03-11 22:54:54,991 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 22:54:54,991 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 22:54:54,991 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-03-11 22:54:54,991 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 22:54:54,992 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-11 22:54:54,992 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:54:54,992 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-11 22:54:54,992 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-11 22:54:54,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-11 22:54:54,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-11 22:54:54,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:54:54,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:54:54,992 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:54:54,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:54:54,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:54:54,992 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:54,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-11 22:54:54,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-11 22:54:54,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:54:54,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-11 22:54:54,993 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:54,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:54,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:54:54,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-11 22:54:54,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:54,995 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:54,995 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-11 22:54:54,995 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-11 22:54:54,995 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:54:54,995 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-11 22:54:54,995 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-11 22:54:54,995 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-11 22:54:54,995 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-03-11 22:54:54,995 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 22:54:54,995 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-03-11 22:54:54,995 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:54:54,995 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:54:54,995 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:54:54,995 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:54:54,995 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-03-11 22:54:54,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:54:54,996 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 22:54:54,996 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:54:54,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:54:55,096 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 22:54:55,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 22:54:55,098 DEBUG [Listener at localhost.localdomain/41563] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-11 22:54:55,098 DEBUG [Listener at localhost.localdomain/41563] regionserver.HStore(1912): 7189059ae0acaaffd2a7e63414af38f7/family1 is initiating major compaction (all files) 2023-03-11 22:54:55,098 INFO [Listener at localhost.localdomain/41563] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-11 22:54:55,098 INFO [Listener at localhost.localdomain/41563] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-11 22:54:55,099 INFO [Listener at localhost.localdomain/41563] regionserver.HRegion(2259): Starting compaction of 7189059ae0acaaffd2a7e63414af38f7/family1 in testCompactionWithHFileLink,2,1678575280100.7189059ae0acaaffd2a7e63414af38f7. 2023-03-11 22:54:55,099 INFO [Listener at localhost.localdomain/41563] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family1/bd42d7e392e844e2a435e9965bbe4b52, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family1/792b51b4e7344f2bb05423e36d8dccac, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family1/70a13ebdab6744bb8dd47dd67237f4ca, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family1/043642cf5ff64bcfbb11167818921f2a, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family1/58c51195aea74495b6f805b0f5ec226b] into tmpdir=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/.tmp, totalSize=26.7 K 2023-03-11 22:54:55,100 DEBUG [Listener at localhost.localdomain/41563] compactions.Compactor(207): Compacting bd42d7e392e844e2a435e9965bbe4b52, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678575282226 2023-03-11 22:54:55,100 DEBUG [Listener at localhost.localdomain/41563] compactions.Compactor(207): Compacting 792b51b4e7344f2bb05423e36d8dccac, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678575284031 2023-03-11 22:54:55,101 DEBUG [Listener at localhost.localdomain/41563] compactions.Compactor(207): Compacting 70a13ebdab6744bb8dd47dd67237f4ca, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678575285864 2023-03-11 22:54:55,101 DEBUG [Listener at localhost.localdomain/41563] compactions.Compactor(207): Compacting 043642cf5ff64bcfbb11167818921f2a, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678575287298 2023-03-11 22:54:55,102 DEBUG [Listener at localhost.localdomain/41563] compactions.Compactor(207): Compacting 58c51195aea74495b6f805b0f5ec226b, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-03-11 22:54:55,121 INFO [Listener at localhost.localdomain/41563] throttle.PressureAwareThroughputController(145): 7189059ae0acaaffd2a7e63414af38f7#family1#compaction#108 average throughput is 0.28 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-11 22:54:55,533 INFO [Listener at localhost.localdomain/41563] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202303114987d77e8299411cadd396d43bf25f1f_del 2023-03-11 22:54:55,533 INFO [Listener at localhost.localdomain/41563] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303114987d77e8299411cadd396d43bf25f1f_del to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202303114987d77e8299411cadd396d43bf25f1f_del 2023-03-11 22:54:56,365 INFO [Listener at localhost.localdomain/41563] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1fc9e5c06c9d4fb29770ae280e0281cc 2023-03-11 22:54:56,366 DEBUG [Listener at localhost.localdomain/41563] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/.tmp/family1/1fc9e5c06c9d4fb29770ae280e0281cc as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family1/1fc9e5c06c9d4fb29770ae280e0281cc 2023-03-11 22:54:56,372 INFO [Listener at localhost.localdomain/41563] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1fc9e5c06c9d4fb29770ae280e0281cc 2023-03-11 22:54:56,373 INFO [Listener at localhost.localdomain/41563] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 7189059ae0acaaffd2a7e63414af38f7/family1 of 7189059ae0acaaffd2a7e63414af38f7 into 1fc9e5c06c9d4fb29770ae280e0281cc(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-11 22:54:56,373 DEBUG [Listener at localhost.localdomain/41563] regionserver.HRegion(2289): Compaction status journal for 7189059ae0acaaffd2a7e63414af38f7: 2023-03-11 22:54:56,373 DEBUG [Listener at localhost.localdomain/41563] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-11 22:54:56,373 DEBUG [Listener at localhost.localdomain/41563] regionserver.HStore(1912): 7189059ae0acaaffd2a7e63414af38f7/family2 is initiating major compaction (all files) 2023-03-11 22:54:56,373 INFO [Listener at localhost.localdomain/41563] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-11 22:54:56,373 INFO [Listener at localhost.localdomain/41563] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-11 22:54:56,374 INFO [Listener at localhost.localdomain/41563] regionserver.HRegion(2259): Starting compaction of 7189059ae0acaaffd2a7e63414af38f7/family2 in testCompactionWithHFileLink,2,1678575280100.7189059ae0acaaffd2a7e63414af38f7. 2023-03-11 22:54:56,374 INFO [Listener at localhost.localdomain/41563] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family2/85d83795bb82460c9e80c58c7c9ee030, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family2/22a1925811b2401c869aa7abba4e22f2, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family2/55033e843476407d82f5c58e2a278d03, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family2/75664672bae7473c96efa0a98a865614, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family2/85880796b68342158247644454216ce8] into tmpdir=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/.tmp, totalSize=25.4 K 2023-03-11 22:54:56,374 DEBUG [Listener at localhost.localdomain/41563] compactions.Compactor(207): Compacting 85d83795bb82460c9e80c58c7c9ee030, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678575282226 2023-03-11 22:54:56,375 DEBUG [Listener at localhost.localdomain/41563] compactions.Compactor(207): Compacting 22a1925811b2401c869aa7abba4e22f2, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678575284031 2023-03-11 22:54:56,376 DEBUG [Listener at localhost.localdomain/41563] compactions.Compactor(207): Compacting 55033e843476407d82f5c58e2a278d03, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678575285864 2023-03-11 22:54:56,376 DEBUG [Listener at localhost.localdomain/41563] compactions.Compactor(207): Compacting 75664672bae7473c96efa0a98a865614, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678575287298 2023-03-11 22:54:56,377 DEBUG [Listener at localhost.localdomain/41563] compactions.Compactor(207): Compacting 85880796b68342158247644454216ce8, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-03-11 22:54:56,394 INFO [Listener at localhost.localdomain/41563] throttle.PressureAwareThroughputController(145): 7189059ae0acaaffd2a7e63414af38f7#family2#compaction#109 average throughput is 0.26 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-11 22:54:56,464 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family1/bd42d7e392e844e2a435e9965bbe4b52, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family1/792b51b4e7344f2bb05423e36d8dccac, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family1/70a13ebdab6744bb8dd47dd67237f4ca, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family1/043642cf5ff64bcfbb11167818921f2a, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family1/58c51195aea74495b6f805b0f5ec226b] to archive 2023-03-11 22:54:56,465 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 22:54:56,467 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family1/bd42d7e392e844e2a435e9965bbe4b52 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family1/bd42d7e392e844e2a435e9965bbe4b52 2023-03-11 22:54:56,469 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family1/792b51b4e7344f2bb05423e36d8dccac to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family1/792b51b4e7344f2bb05423e36d8dccac 2023-03-11 22:54:56,471 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family1/70a13ebdab6744bb8dd47dd67237f4ca to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family1/70a13ebdab6744bb8dd47dd67237f4ca 2023-03-11 22:54:56,472 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family1/043642cf5ff64bcfbb11167818921f2a to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family1/043642cf5ff64bcfbb11167818921f2a 2023-03-11 22:54:56,473 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family1/58c51195aea74495b6f805b0f5ec226b to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family1/58c51195aea74495b6f805b0f5ec226b 2023-03-11 22:54:56,813 INFO [Listener at localhost.localdomain/41563] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c2023031190986fdb672a4e2b8c0e4c7d39c62715_del 2023-03-11 22:54:56,813 INFO [Listener at localhost.localdomain/41563] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023031190986fdb672a4e2b8c0e4c7d39c62715_del to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023031190986fdb672a4e2b8c0e4c7d39c62715_del 2023-03-11 22:54:57,642 INFO [Listener at localhost.localdomain/41563] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8183e16b74a54227a197dcb65759111e 2023-03-11 22:54:57,643 DEBUG [Listener at localhost.localdomain/41563] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/.tmp/family2/8183e16b74a54227a197dcb65759111e as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family2/8183e16b74a54227a197dcb65759111e 2023-03-11 22:54:57,648 INFO [Listener at localhost.localdomain/41563] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8183e16b74a54227a197dcb65759111e 2023-03-11 22:54:57,648 INFO [Listener at localhost.localdomain/41563] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 7189059ae0acaaffd2a7e63414af38f7/family2 of 7189059ae0acaaffd2a7e63414af38f7 into 8183e16b74a54227a197dcb65759111e(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-11 22:54:57,649 DEBUG [Listener at localhost.localdomain/41563] regionserver.HRegion(2289): Compaction status journal for 7189059ae0acaaffd2a7e63414af38f7: 2023-03-11 22:54:57,649 DEBUG [Listener at localhost.localdomain/41563] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-11 22:54:57,649 DEBUG [Listener at localhost.localdomain/41563] regionserver.HStore(1912): f5ff2dc2c8d65f11f0ecb2681def8a43/family1 is initiating major compaction (all files) 2023-03-11 22:54:57,649 INFO [Listener at localhost.localdomain/41563] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-11 22:54:57,649 INFO [Listener at localhost.localdomain/41563] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-11 22:54:57,649 INFO [Listener at localhost.localdomain/41563] regionserver.HRegion(2259): Starting compaction of f5ff2dc2c8d65f11f0ecb2681def8a43/family1 in testCompactionWithHFileLink,,1678575280100.f5ff2dc2c8d65f11f0ecb2681def8a43. 2023-03-11 22:54:57,649 INFO [Listener at localhost.localdomain/41563] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family1/b71bc618951c43e69e774b42be4b0bef, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family1/6dcf1deb771d4f1684637d7e9f23839d, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family1/a2c8cd3ba10746a5857f359843a355cb, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family1/7da2cf4d34844cb08bfda2f1981a5aa3, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family1/d84f132011a640259b0b91b530a99d80] into tmpdir=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/.tmp, totalSize=26.7 K 2023-03-11 22:54:57,650 DEBUG [Listener at localhost.localdomain/41563] compactions.Compactor(207): Compacting b71bc618951c43e69e774b42be4b0bef, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678575282225 2023-03-11 22:54:57,650 DEBUG [Listener at localhost.localdomain/41563] compactions.Compactor(207): Compacting 6dcf1deb771d4f1684637d7e9f23839d, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678575284029 2023-03-11 22:54:57,651 DEBUG [Listener at localhost.localdomain/41563] compactions.Compactor(207): Compacting a2c8cd3ba10746a5857f359843a355cb, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678575285863 2023-03-11 22:54:57,651 DEBUG [Listener at localhost.localdomain/41563] compactions.Compactor(207): Compacting 7da2cf4d34844cb08bfda2f1981a5aa3, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678575287297 2023-03-11 22:54:57,651 DEBUG [Listener at localhost.localdomain/41563] compactions.Compactor(207): Compacting d84f132011a640259b0b91b530a99d80, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-03-11 22:54:57,662 INFO [Listener at localhost.localdomain/41563] throttle.PressureAwareThroughputController(145): f5ff2dc2c8d65f11f0ecb2681def8a43#family1#compaction#110 average throughput is 0.85 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-11 22:54:57,666 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family2/85d83795bb82460c9e80c58c7c9ee030, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family2/22a1925811b2401c869aa7abba4e22f2, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family2/55033e843476407d82f5c58e2a278d03, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family2/75664672bae7473c96efa0a98a865614, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family2/85880796b68342158247644454216ce8] to archive 2023-03-11 22:54:57,666 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 22:54:57,668 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family2/85d83795bb82460c9e80c58c7c9ee030 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family2/85d83795bb82460c9e80c58c7c9ee030 2023-03-11 22:54:57,669 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family2/22a1925811b2401c869aa7abba4e22f2 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family2/22a1925811b2401c869aa7abba4e22f2 2023-03-11 22:54:57,670 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family2/55033e843476407d82f5c58e2a278d03 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family2/55033e843476407d82f5c58e2a278d03 2023-03-11 22:54:57,672 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family2/75664672bae7473c96efa0a98a865614 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family2/75664672bae7473c96efa0a98a865614 2023-03-11 22:54:57,673 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family2/85880796b68342158247644454216ce8 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family2/85880796b68342158247644454216ce8 2023-03-11 22:54:58,077 INFO [Listener at localhost.localdomain/41563] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202303117347eb69ff1a41c6a23488b104cd8340_del 2023-03-11 22:54:58,078 INFO [Listener at localhost.localdomain/41563] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303117347eb69ff1a41c6a23488b104cd8340_del to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202303117347eb69ff1a41c6a23488b104cd8340_del 2023-03-11 22:54:58,907 INFO [Listener at localhost.localdomain/41563] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7a89d096daf54b56b976023e29c42366 2023-03-11 22:54:58,908 DEBUG [Listener at localhost.localdomain/41563] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/.tmp/family1/7a89d096daf54b56b976023e29c42366 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family1/7a89d096daf54b56b976023e29c42366 2023-03-11 22:54:58,910 INFO [Listener at localhost.localdomain/41563] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7a89d096daf54b56b976023e29c42366 2023-03-11 22:54:58,911 INFO [Listener at localhost.localdomain/41563] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in f5ff2dc2c8d65f11f0ecb2681def8a43/family1 of f5ff2dc2c8d65f11f0ecb2681def8a43 into 7a89d096daf54b56b976023e29c42366(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-11 22:54:58,911 DEBUG [Listener at localhost.localdomain/41563] regionserver.HRegion(2289): Compaction status journal for f5ff2dc2c8d65f11f0ecb2681def8a43: 2023-03-11 22:54:58,911 DEBUG [Listener at localhost.localdomain/41563] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-11 22:54:58,911 DEBUG [Listener at localhost.localdomain/41563] regionserver.HStore(1912): f5ff2dc2c8d65f11f0ecb2681def8a43/family2 is initiating major compaction (all files) 2023-03-11 22:54:58,912 INFO [Listener at localhost.localdomain/41563] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-11 22:54:58,912 INFO [Listener at localhost.localdomain/41563] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-11 22:54:58,912 INFO [Listener at localhost.localdomain/41563] regionserver.HRegion(2259): Starting compaction of f5ff2dc2c8d65f11f0ecb2681def8a43/family2 in testCompactionWithHFileLink,,1678575280100.f5ff2dc2c8d65f11f0ecb2681def8a43. 2023-03-11 22:54:58,912 INFO [Listener at localhost.localdomain/41563] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family2/56a3feebc66c4f1b84e6eae2fe9cef71, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family2/9811e2f543154038a3c389b2b7bae676, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family2/79ebb06592894586af3575e3868c1041, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family2/3968f87f78914e98a705a9c15c526df6, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family2/351861d1830a4fb7883bfff7135d3f5e] into tmpdir=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/.tmp, totalSize=25.4 K 2023-03-11 22:54:58,912 DEBUG [Listener at localhost.localdomain/41563] compactions.Compactor(207): Compacting 56a3feebc66c4f1b84e6eae2fe9cef71, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678575282225 2023-03-11 22:54:58,912 DEBUG [Listener at localhost.localdomain/41563] compactions.Compactor(207): Compacting 9811e2f543154038a3c389b2b7bae676, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678575284029 2023-03-11 22:54:58,913 DEBUG [Listener at localhost.localdomain/41563] compactions.Compactor(207): Compacting 79ebb06592894586af3575e3868c1041, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678575285863 2023-03-11 22:54:58,913 DEBUG [Listener at localhost.localdomain/41563] compactions.Compactor(207): Compacting 3968f87f78914e98a705a9c15c526df6, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678575287297 2023-03-11 22:54:58,913 DEBUG [Listener at localhost.localdomain/41563] compactions.Compactor(207): Compacting 351861d1830a4fb7883bfff7135d3f5e, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-03-11 22:54:58,924 INFO [Listener at localhost.localdomain/41563] throttle.PressureAwareThroughputController(145): f5ff2dc2c8d65f11f0ecb2681def8a43#family2#compaction#111 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-11 22:54:58,965 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family1/b71bc618951c43e69e774b42be4b0bef, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family1/6dcf1deb771d4f1684637d7e9f23839d, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family1/a2c8cd3ba10746a5857f359843a355cb, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family1/7da2cf4d34844cb08bfda2f1981a5aa3, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family1/d84f132011a640259b0b91b530a99d80] to archive 2023-03-11 22:54:58,966 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 22:54:58,968 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family1/b71bc618951c43e69e774b42be4b0bef to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family1/b71bc618951c43e69e774b42be4b0bef 2023-03-11 22:54:58,970 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family1/6dcf1deb771d4f1684637d7e9f23839d to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family1/6dcf1deb771d4f1684637d7e9f23839d 2023-03-11 22:54:58,972 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family1/a2c8cd3ba10746a5857f359843a355cb to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family1/a2c8cd3ba10746a5857f359843a355cb 2023-03-11 22:54:58,974 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family1/7da2cf4d34844cb08bfda2f1981a5aa3 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family1/7da2cf4d34844cb08bfda2f1981a5aa3 2023-03-11 22:54:58,976 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family1/d84f132011a640259b0b91b530a99d80 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family1/d84f132011a640259b0b91b530a99d80 2023-03-11 22:54:59,341 INFO [Listener at localhost.localdomain/41563] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202303113fe2648247a94d5b8601a376956599d5_del 2023-03-11 22:54:59,341 INFO [Listener at localhost.localdomain/41563] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303113fe2648247a94d5b8601a376956599d5_del to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202303113fe2648247a94d5b8601a376956599d5_del 2023-03-11 22:55:00,173 INFO [Listener at localhost.localdomain/41563] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 34a21d0962fd4f67babe633e97f868d7 2023-03-11 22:55:00,174 DEBUG [Listener at localhost.localdomain/41563] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/.tmp/family2/34a21d0962fd4f67babe633e97f868d7 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family2/34a21d0962fd4f67babe633e97f868d7 2023-03-11 22:55:00,177 INFO [Listener at localhost.localdomain/41563] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 34a21d0962fd4f67babe633e97f868d7 2023-03-11 22:55:00,178 INFO [Listener at localhost.localdomain/41563] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in f5ff2dc2c8d65f11f0ecb2681def8a43/family2 of f5ff2dc2c8d65f11f0ecb2681def8a43 into 34a21d0962fd4f67babe633e97f868d7(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-11 22:55:00,178 DEBUG [Listener at localhost.localdomain/41563] regionserver.HRegion(2289): Compaction status journal for f5ff2dc2c8d65f11f0ecb2681def8a43: 2023-03-11 22:55:00,178 DEBUG [Listener at localhost.localdomain/41563] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-11 22:55:00,178 DEBUG [Listener at localhost.localdomain/41563] regionserver.HStore(1912): c9557b829346f7133c6ea3c6c1b42236/family1 is initiating major compaction (all files) 2023-03-11 22:55:00,178 INFO [Listener at localhost.localdomain/41563] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-11 22:55:00,178 INFO [Listener at localhost.localdomain/41563] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-11 22:55:00,178 INFO [Listener at localhost.localdomain/41563] regionserver.HRegion(2259): Starting compaction of c9557b829346f7133c6ea3c6c1b42236/family1 in testCompactionWithHFileLink,1,1678575280100.c9557b829346f7133c6ea3c6c1b42236. 2023-03-11 22:55:00,178 INFO [Listener at localhost.localdomain/41563] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family1/de777f4aa41a4d8fb92468da0d003d99, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family1/501392378a5d499b90c1edfbc30e4277, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family1/18bc795cc708409888f506cea46a1ceb, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family1/d4a76178692149918ee59f0c53bd768e, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family1/4b0ad1a39dbb40dab16f4dc8e4341fad] into tmpdir=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/.tmp, totalSize=26.7 K 2023-03-11 22:55:00,179 DEBUG [Listener at localhost.localdomain/41563] compactions.Compactor(207): Compacting de777f4aa41a4d8fb92468da0d003d99, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678575282226 2023-03-11 22:55:00,179 DEBUG [Listener at localhost.localdomain/41563] compactions.Compactor(207): Compacting 501392378a5d499b90c1edfbc30e4277, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678575284030 2023-03-11 22:55:00,179 DEBUG [Listener at localhost.localdomain/41563] compactions.Compactor(207): Compacting 18bc795cc708409888f506cea46a1ceb, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678575285863 2023-03-11 22:55:00,180 DEBUG [Listener at localhost.localdomain/41563] compactions.Compactor(207): Compacting d4a76178692149918ee59f0c53bd768e, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678575287298 2023-03-11 22:55:00,180 DEBUG [Listener at localhost.localdomain/41563] compactions.Compactor(207): Compacting 4b0ad1a39dbb40dab16f4dc8e4341fad, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-03-11 22:55:00,189 INFO [Listener at localhost.localdomain/41563] throttle.PressureAwareThroughputController(145): c9557b829346f7133c6ea3c6c1b42236#family1#compaction#112 average throughput is 0.85 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-11 22:55:00,269 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family2/56a3feebc66c4f1b84e6eae2fe9cef71, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family2/9811e2f543154038a3c389b2b7bae676, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family2/79ebb06592894586af3575e3868c1041, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family2/3968f87f78914e98a705a9c15c526df6, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family2/351861d1830a4fb7883bfff7135d3f5e] to archive 2023-03-11 22:55:00,270 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 22:55:00,273 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family2/56a3feebc66c4f1b84e6eae2fe9cef71 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family2/56a3feebc66c4f1b84e6eae2fe9cef71 2023-03-11 22:55:00,276 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family2/9811e2f543154038a3c389b2b7bae676 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family2/9811e2f543154038a3c389b2b7bae676 2023-03-11 22:55:00,279 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family2/79ebb06592894586af3575e3868c1041 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family2/79ebb06592894586af3575e3868c1041 2023-03-11 22:55:00,281 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family2/3968f87f78914e98a705a9c15c526df6 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family2/3968f87f78914e98a705a9c15c526df6 2023-03-11 22:55:00,283 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family2/351861d1830a4fb7883bfff7135d3f5e to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family2/351861d1830a4fb7883bfff7135d3f5e 2023-03-11 22:55:00,604 INFO [Listener at localhost.localdomain/41563] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202303111a7b235fabf440d29fb0c83583ff2131_del 2023-03-11 22:55:00,604 INFO [Listener at localhost.localdomain/41563] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202303111a7b235fabf440d29fb0c83583ff2131_del to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202303111a7b235fabf440d29fb0c83583ff2131_del 2023-03-11 22:55:01,434 INFO [Listener at localhost.localdomain/41563] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for da87c83f7d9d463e8da03c4222912e64 2023-03-11 22:55:01,435 DEBUG [Listener at localhost.localdomain/41563] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/.tmp/family1/da87c83f7d9d463e8da03c4222912e64 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family1/da87c83f7d9d463e8da03c4222912e64 2023-03-11 22:55:01,439 INFO [Listener at localhost.localdomain/41563] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for da87c83f7d9d463e8da03c4222912e64 2023-03-11 22:55:01,440 INFO [Listener at localhost.localdomain/41563] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in c9557b829346f7133c6ea3c6c1b42236/family1 of c9557b829346f7133c6ea3c6c1b42236 into da87c83f7d9d463e8da03c4222912e64(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-11 22:55:01,441 DEBUG [Listener at localhost.localdomain/41563] regionserver.HRegion(2289): Compaction status journal for c9557b829346f7133c6ea3c6c1b42236: 2023-03-11 22:55:01,441 DEBUG [Listener at localhost.localdomain/41563] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-11 22:55:01,441 DEBUG [Listener at localhost.localdomain/41563] regionserver.HStore(1912): c9557b829346f7133c6ea3c6c1b42236/family2 is initiating major compaction (all files) 2023-03-11 22:55:01,441 INFO [Listener at localhost.localdomain/41563] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-11 22:55:01,441 INFO [Listener at localhost.localdomain/41563] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-11 22:55:01,441 INFO [Listener at localhost.localdomain/41563] regionserver.HRegion(2259): Starting compaction of c9557b829346f7133c6ea3c6c1b42236/family2 in testCompactionWithHFileLink,1,1678575280100.c9557b829346f7133c6ea3c6c1b42236. 2023-03-11 22:55:01,441 INFO [Listener at localhost.localdomain/41563] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family2/f0aea611a01547acbf71afe50f36b56e, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family2/08c74fbf215e40af9afa551a84198fdc, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family2/f8c70657fdc84511b043d1760c4a13b4, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family2/03ba98a6910540ec9e47b184aac49932, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family2/4f41ef71a89d44a3a1aa87992e33d9e8] into tmpdir=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/.tmp, totalSize=25.4 K 2023-03-11 22:55:01,442 DEBUG [Listener at localhost.localdomain/41563] compactions.Compactor(207): Compacting f0aea611a01547acbf71afe50f36b56e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678575282226 2023-03-11 22:55:01,442 DEBUG [Listener at localhost.localdomain/41563] compactions.Compactor(207): Compacting 08c74fbf215e40af9afa551a84198fdc, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678575284030 2023-03-11 22:55:01,442 DEBUG [Listener at localhost.localdomain/41563] compactions.Compactor(207): Compacting f8c70657fdc84511b043d1760c4a13b4, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678575285863 2023-03-11 22:55:01,443 DEBUG [Listener at localhost.localdomain/41563] compactions.Compactor(207): Compacting 03ba98a6910540ec9e47b184aac49932, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678575287298 2023-03-11 22:55:01,443 DEBUG [Listener at localhost.localdomain/41563] compactions.Compactor(207): Compacting 4f41ef71a89d44a3a1aa87992e33d9e8, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-03-11 22:55:01,458 INFO [Listener at localhost.localdomain/41563] throttle.PressureAwareThroughputController(145): c9557b829346f7133c6ea3c6c1b42236#family2#compaction#113 average throughput is 0.15 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-11 22:55:01,465 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family1/de777f4aa41a4d8fb92468da0d003d99, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family1/501392378a5d499b90c1edfbc30e4277, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family1/18bc795cc708409888f506cea46a1ceb, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family1/d4a76178692149918ee59f0c53bd768e, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family1/4b0ad1a39dbb40dab16f4dc8e4341fad] to archive 2023-03-11 22:55:01,466 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 22:55:01,467 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family1/de777f4aa41a4d8fb92468da0d003d99 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family1/de777f4aa41a4d8fb92468da0d003d99 2023-03-11 22:55:01,468 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family1/501392378a5d499b90c1edfbc30e4277 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family1/501392378a5d499b90c1edfbc30e4277 2023-03-11 22:55:01,469 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family1/18bc795cc708409888f506cea46a1ceb to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family1/18bc795cc708409888f506cea46a1ceb 2023-03-11 22:55:01,470 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family1/d4a76178692149918ee59f0c53bd768e to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family1/d4a76178692149918ee59f0c53bd768e 2023-03-11 22:55:01,471 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family1/4b0ad1a39dbb40dab16f4dc8e4341fad to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family1/4b0ad1a39dbb40dab16f4dc8e4341fad 2023-03-11 22:55:01,877 INFO [Listener at localhost.localdomain/41563] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230311afe2940811f543c093d0b2e76a766c62_del 2023-03-11 22:55:01,877 INFO [Listener at localhost.localdomain/41563] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230311afe2940811f543c093d0b2e76a766c62_del to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230311afe2940811f543c093d0b2e76a766c62_del 2023-03-11 22:55:02,301 INFO [Listener at localhost.localdomain/41563] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 06271d10502949f8acccb38636334d64 2023-03-11 22:55:02,303 DEBUG [Listener at localhost.localdomain/41563] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/.tmp/family2/06271d10502949f8acccb38636334d64 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family2/06271d10502949f8acccb38636334d64 2023-03-11 22:55:02,308 INFO [Listener at localhost.localdomain/41563] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 06271d10502949f8acccb38636334d64 2023-03-11 22:55:02,309 INFO [Listener at localhost.localdomain/41563] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in c9557b829346f7133c6ea3c6c1b42236/family2 of c9557b829346f7133c6ea3c6c1b42236 into 06271d10502949f8acccb38636334d64(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-11 22:55:02,309 DEBUG [Listener at localhost.localdomain/41563] regionserver.HRegion(2289): Compaction status journal for c9557b829346f7133c6ea3c6c1b42236: 2023-03-11 22:55:02,316 DEBUG [Listener at localhost.localdomain/41563] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-11 22:55:02,321 DEBUG [Listener at localhost.localdomain/41563] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-11 22:55:02,328 DEBUG [Listener at localhost.localdomain/41563] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-11 22:55:02,329 DEBUG [Listener at localhost.localdomain/41563] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-11 22:55:02,335 INFO [Listener at localhost.localdomain/41563] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-03-11 22:55:02,366 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family2/f0aea611a01547acbf71afe50f36b56e, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family2/08c74fbf215e40af9afa551a84198fdc, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family2/f8c70657fdc84511b043d1760c4a13b4, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family2/03ba98a6910540ec9e47b184aac49932, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family2/4f41ef71a89d44a3a1aa87992e33d9e8] to archive 2023-03-11 22:55:02,366 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 22:55:02,368 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family2/f0aea611a01547acbf71afe50f36b56e to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family2/f0aea611a01547acbf71afe50f36b56e 2023-03-11 22:55:02,369 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family2/08c74fbf215e40af9afa551a84198fdc to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family2/08c74fbf215e40af9afa551a84198fdc 2023-03-11 22:55:02,370 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family2/f8c70657fdc84511b043d1760c4a13b4 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family2/f8c70657fdc84511b043d1760c4a13b4 2023-03-11 22:55:02,371 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family2/03ba98a6910540ec9e47b184aac49932 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family2/03ba98a6910540ec9e47b184aac49932 2023-03-11 22:55:02,372 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family2/4f41ef71a89d44a3a1aa87992e33d9e8 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family2/4f41ef71a89d44a3a1aa87992e33d9e8 2023-03-11 22:55:02,374 INFO [Listener at localhost.localdomain/41563] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 3 del files, 12 selected files, and 0 irrelevant files table 'testCompactionWithHFileLink' and column 'family1' 2023-03-11 22:55:02,378 INFO [Listener at localhost.localdomain/41563] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202303117347eb69ff1a41c6a23488b104cd8340_del 2023-03-11 22:55:02,381 INFO [Listener at localhost.localdomain/41563] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202303111a7b235fabf440d29fb0c83583ff2131_del 2023-03-11 22:55:02,384 INFO [Listener at localhost.localdomain/41563] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202303114987d77e8299411cadd396d43bf25f1f_del 2023-03-11 22:55:02,385 INFO [Listener at localhost.localdomain/41563] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='testCompactionWithHFileLink' column='family1' 2023-03-11 22:55:02,385 DEBUG [Listener at localhost.localdomain/41563] zookeeper.ReadOnlyZKClient(139): Connect 0x534804c5 to 127.0.0.1:51815 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-11 22:55:02,389 DEBUG [Listener at localhost.localdomain/41563] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@ed4688, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-11 22:55:02,389 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230311 for table='testCompactionWithHFileLink' and column='family1' 2023-03-11 22:55:02,390 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230311 for table='testCompactionWithHFileLink' and column='family1' 2023-03-11 22:55:02,390 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230311 for table='testCompactionWithHFileLink' and column='family1' 2023-03-11 22:55:02,858 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230311565649dea7d9497393be98f96c7c338d to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230311565649dea7d9497393be98f96c7c338d 2023-03-11 22:55:02,858 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230311 table='testCompactionWithHFileLink' column='family1' 2023-03-11 22:55:02,870 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-11 22:55:02,873 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:55082, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-11 22:55:02,880 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-11 22:55:02,883 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:60894, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-11 22:55:02,890 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230311/family1/6832126a68904212b1dbb05e29f58bcc first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x07] 2023-03-11 22:55:02,891 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,1,1678575280100.c9557b829346f7133c6ea3c6c1b42236., hostname=jenkins-hbase20.apache.org,41843,1678575183185, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230311/family1/6832126a68904212b1dbb05e29f58bcc}] 2023-03-11 22:55:02,895 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230311/family1/6832126a68904212b1dbb05e29f58bcc for inclusion in c9557b829346f7133c6ea3c6c1b42236/family1 2023-03-11 22:55:02,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x07 2023-03-11 22:55:02,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(777): Region bounds: first=1 last=2 2023-03-11 22:55:02,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HRegion(2446): Flush status journal for c9557b829346f7133c6ea3c6c1b42236: 2023-03-11 22:55:02,898 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230311/family1/6832126a68904212b1dbb05e29f58bcc to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testCompactionWithHFileLink__l1i08h61fd79c9glittij95ul8jjb1iontb5aig5mncch2n2qask1rhk2hnpdb3s/family1/6832126a68904212b1dbb05e29f58bcc 2023-03-11 22:55:02,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testCompactionWithHFileLink__l1i08h61fd79c9glittij95ul8jjb1iontb5aig5mncch2n2qask1rhk2hnpdb3s/family1/6832126a68904212b1dbb05e29f58bcc as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family1/4813388373f14c4ea377a261e7d8f572_SeqId_29_ 2023-03-11 22:55:02,901 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testCompactionWithHFileLink__l1i08h61fd79c9glittij95ul8jjb1iontb5aig5mncch2n2qask1rhk2hnpdb3s/family1/6832126a68904212b1dbb05e29f58bcc into c9557b829346f7133c6ea3c6c1b42236/family1 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family1/4813388373f14c4ea377a261e7d8f572_SeqId_29_ - updating store file list. 2023-03-11 22:55:02,904 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family1/4813388373f14c4ea377a261e7d8f572_SeqId_29_ into c9557b829346f7133c6ea3c6c1b42236/family1 2023-03-11 22:55:02,904 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testCompactionWithHFileLink__l1i08h61fd79c9glittij95ul8jjb1iontb5aig5mncch2n2qask1rhk2hnpdb3s/family1/6832126a68904212b1dbb05e29f58bcc into c9557b829346f7133c6ea3c6c1b42236/family1 (new location: hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family1/4813388373f14c4ea377a261e7d8f572_SeqId_29_) 2023-03-11 22:55:02,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testCompactionWithHFileLink__l1i08h61fd79c9glittij95ul8jjb1iontb5aig5mncch2n2qask1rhk2hnpdb3s/family1/6832126a68904212b1dbb05e29f58bcc 2023-03-11 22:55:02,906 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230311 table='testCompactionWithHFileLink' column='family1' 2023-03-11 22:55:02,907 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 22:55:02,908 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202303118527fef18c5e485c949f1cd3a30c3aaa to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202303118527fef18c5e485c949f1cd3a30c3aaa 2023-03-11 22:55:02,909 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230311a27e4a83b27c4b30b2875268932f5f96 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230311a27e4a83b27c4b30b2875268932f5f96 2023-03-11 22:55:02,910 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230311d39059d225114219bb95e51a3bf73129 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230311d39059d225114219bb95e51a3bf73129 2023-03-11 22:55:02,912 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230311ecd72b1e22a74ca4941b5e1642c89708 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230311ecd72b1e22a74ca4941b5e1642c89708 2023-03-11 22:55:02,912 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-03-11 22:55:02,912 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230311' 2023-03-11 22:55:02,912 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230311 for table='testCompactionWithHFileLink' and column='family1' 2023-03-11 22:55:03,265 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230311c6faf1b70fbb43c1bcecb3ed6946fcf2 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230311c6faf1b70fbb43c1bcecb3ed6946fcf2 2023-03-11 22:55:03,266 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303112ee4409db62d4336888f5681542cfc52 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202303112ee4409db62d4336888f5681542cfc52 2023-03-11 22:55:03,266 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230311 table='testCompactionWithHFileLink' column='family1' 2023-03-11 22:55:03,267 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230311 table='testCompactionWithHFileLink' column='family1' 2023-03-11 22:55:03,290 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230311/family1/092c7c421296471b91f5a72bfda22508 first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x07] 2023-03-11 22:55:03,292 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,,1678575280100.f5ff2dc2c8d65f11f0ecb2681def8a43., hostname=jenkins-hbase20.apache.org,41843,1678575183185, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230311/family1/092c7c421296471b91f5a72bfda22508}] 2023-03-11 22:55:03,294 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230311/family1/092c7c421296471b91f5a72bfda22508 for inclusion in f5ff2dc2c8d65f11f0ecb2681def8a43/family1 2023-03-11 22:55:03,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x07 2023-03-11 22:55:03,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.HStore(777): Region bounds: first= last=1 2023-03-11 22:55:03,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.HRegion(2446): Flush status journal for f5ff2dc2c8d65f11f0ecb2681def8a43: 2023-03-11 22:55:03,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230311/family1/092c7c421296471b91f5a72bfda22508 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testCompactionWithHFileLink__ptiqclvg6ru5l1krksvnik1r92oj2q3d2eq0f1103ajc07eheva7i2e9kcc99ag1/family1/092c7c421296471b91f5a72bfda22508 2023-03-11 22:55:03,299 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230311/family1/b09c908684fe41d3ab5366782da0512b first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x07] 2023-03-11 22:55:03,300 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,2,1678575280100.7189059ae0acaaffd2a7e63414af38f7., hostname=jenkins-hbase20.apache.org,41843,1678575183185, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230311/family1/b09c908684fe41d3ab5366782da0512b}] 2023-03-11 22:55:03,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testCompactionWithHFileLink__ptiqclvg6ru5l1krksvnik1r92oj2q3d2eq0f1103ajc07eheva7i2e9kcc99ag1/family1/092c7c421296471b91f5a72bfda22508 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family1/77c90167913a49e2af7992e59f7224fe_SeqId_29_ 2023-03-11 22:55:03,302 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230311/family1/b09c908684fe41d3ab5366782da0512b for inclusion in 7189059ae0acaaffd2a7e63414af38f7/family1 2023-03-11 22:55:03,302 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testCompactionWithHFileLink__ptiqclvg6ru5l1krksvnik1r92oj2q3d2eq0f1103ajc07eheva7i2e9kcc99ag1/family1/092c7c421296471b91f5a72bfda22508 into f5ff2dc2c8d65f11f0ecb2681def8a43/family1 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family1/77c90167913a49e2af7992e59f7224fe_SeqId_29_ - updating store file list. 2023-03-11 22:55:03,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x07 2023-03-11 22:55:03,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(777): Region bounds: first=2 last= 2023-03-11 22:55:03,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HRegion(2446): Flush status journal for 7189059ae0acaaffd2a7e63414af38f7: 2023-03-11 22:55:03,305 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family1/77c90167913a49e2af7992e59f7224fe_SeqId_29_ into f5ff2dc2c8d65f11f0ecb2681def8a43/family1 2023-03-11 22:55:03,305 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testCompactionWithHFileLink__ptiqclvg6ru5l1krksvnik1r92oj2q3d2eq0f1103ajc07eheva7i2e9kcc99ag1/family1/092c7c421296471b91f5a72bfda22508 into f5ff2dc2c8d65f11f0ecb2681def8a43/family1 (new location: hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family1/77c90167913a49e2af7992e59f7224fe_SeqId_29_) 2023-03-11 22:55:03,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230311/family1/b09c908684fe41d3ab5366782da0512b to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testCompactionWithHFileLink__cos3akcnhs06tvgp1e63tkcl1k9sdftbp62g385f9c11hq5u369u0pn7tgmr4tmk/family1/b09c908684fe41d3ab5366782da0512b 2023-03-11 22:55:03,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testCompactionWithHFileLink__ptiqclvg6ru5l1krksvnik1r92oj2q3d2eq0f1103ajc07eheva7i2e9kcc99ag1/family1/092c7c421296471b91f5a72bfda22508 2023-03-11 22:55:03,309 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230311 table='testCompactionWithHFileLink' column='family1' 2023-03-11 22:55:03,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testCompactionWithHFileLink__cos3akcnhs06tvgp1e63tkcl1k9sdftbp62g385f9c11hq5u369u0pn7tgmr4tmk/family1/b09c908684fe41d3ab5366782da0512b as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family1/38dac416abb34db6b30e0c2fd51a45db_SeqId_29_ 2023-03-11 22:55:03,309 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 22:55:03,310 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testCompactionWithHFileLink__cos3akcnhs06tvgp1e63tkcl1k9sdftbp62g385f9c11hq5u369u0pn7tgmr4tmk/family1/b09c908684fe41d3ab5366782da0512b into 7189059ae0acaaffd2a7e63414af38f7/family1 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family1/38dac416abb34db6b30e0c2fd51a45db_SeqId_29_ - updating store file list. 2023-03-11 22:55:03,310 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202303113fc32ad601054ce383d790ba61e9b1d9 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202303113fc32ad601054ce383d790ba61e9b1d9 2023-03-11 22:55:03,311 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202303119f211bc34e194a71bf189bd5baf45037 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202303119f211bc34e194a71bf189bd5baf45037 2023-03-11 22:55:03,311 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230311eadcedaacb5d4629984edc323cb2ca58 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230311eadcedaacb5d4629984edc323cb2ca58 2023-03-11 22:55:03,312 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family1/38dac416abb34db6b30e0c2fd51a45db_SeqId_29_ into 7189059ae0acaaffd2a7e63414af38f7/family1 2023-03-11 22:55:03,312 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230311f3e1642b0eae497e8943343bd9127843 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230311f3e1642b0eae497e8943343bd9127843 2023-03-11 22:55:03,312 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testCompactionWithHFileLink__cos3akcnhs06tvgp1e63tkcl1k9sdftbp62g385f9c11hq5u369u0pn7tgmr4tmk/family1/b09c908684fe41d3ab5366782da0512b into 7189059ae0acaaffd2a7e63414af38f7/family1 (new location: hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family1/38dac416abb34db6b30e0c2fd51a45db_SeqId_29_) 2023-03-11 22:55:03,312 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-03-11 22:55:03,312 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230311' 2023-03-11 22:55:03,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testCompactionWithHFileLink__cos3akcnhs06tvgp1e63tkcl1k9sdftbp62g385f9c11hq5u369u0pn7tgmr4tmk/family1/b09c908684fe41d3ab5366782da0512b 2023-03-11 22:55:03,313 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230311 for table='testCompactionWithHFileLink' and column='family1' 2023-03-11 22:55:03,314 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230311 table='testCompactionWithHFileLink' column='family1' 2023-03-11 22:55:03,314 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 22:55:03,315 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202303112d52c5edbd894361b1998c4735e4a082 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202303112d52c5edbd894361b1998c4735e4a082 2023-03-11 22:55:03,316 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202303117cac817e46b249e58838f77e044220eb to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202303117cac817e46b249e58838f77e044220eb 2023-03-11 22:55:03,316 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202303119e2f565be17f40a48d173fb84aee091c to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202303119e2f565be17f40a48d173fb84aee091c 2023-03-11 22:55:03,317 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230311e5edfb7e86044da99c8e8fc0b0d075d5 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230311e5edfb7e86044da99c8e8fc0b0d075d5 2023-03-11 22:55:03,317 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-03-11 22:55:03,317 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230311' 2023-03-11 22:55:03,317 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230311 for table='testCompactionWithHFileLink' and column='family1' 2023-03-11 22:55:03,317 INFO [Listener at localhost.localdomain/41563] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testCompactionWithHFileLink' column='family1' 2023-03-11 22:55:03,317 INFO [Listener at localhost.localdomain/41563] compactions.PartitionedMobCompactor(364): After a mob compaction with all files selected, archiving the del files for table='testCompactionWithHFileLink' and column='family1' 2023-03-11 22:55:03,317 INFO [Listener at localhost.localdomain/41563] compactions.PartitionedMobCompactor(367): [hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202303117347eb69ff1a41c6a23488b104cd8340_del] 2023-03-11 22:55:03,318 DEBUG [Listener at localhost.localdomain/41563] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 22:55:03,319 DEBUG [Listener at localhost.localdomain/41563] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202303117347eb69ff1a41c6a23488b104cd8340_del to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202303117347eb69ff1a41c6a23488b104cd8340_del 2023-03-11 22:55:03,319 INFO [Listener at localhost.localdomain/41563] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-03-11 22:55:03,319 INFO [Listener at localhost.localdomain/41563] compactions.PartitionedMobCompactor(367): [hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202303111a7b235fabf440d29fb0c83583ff2131_del] 2023-03-11 22:55:03,319 DEBUG [Listener at localhost.localdomain/41563] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 22:55:03,320 DEBUG [Listener at localhost.localdomain/41563] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202303111a7b235fabf440d29fb0c83583ff2131_del to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202303111a7b235fabf440d29fb0c83583ff2131_del 2023-03-11 22:55:03,320 INFO [Listener at localhost.localdomain/41563] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-03-11 22:55:03,320 INFO [Listener at localhost.localdomain/41563] compactions.PartitionedMobCompactor(367): [hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202303114987d77e8299411cadd396d43bf25f1f_del] 2023-03-11 22:55:03,320 DEBUG [Listener at localhost.localdomain/41563] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 22:55:03,321 DEBUG [Listener at localhost.localdomain/41563] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202303114987d77e8299411cadd396d43bf25f1f_del to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202303114987d77e8299411cadd396d43bf25f1f_del 2023-03-11 22:55:03,321 INFO [Listener at localhost.localdomain/41563] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-03-11 22:55:03,324 DEBUG [Listener at localhost.localdomain/41563] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-11 22:55:03,325 DEBUG [Listener at localhost.localdomain/41563] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-11 22:55:03,328 DEBUG [Listener at localhost.localdomain/41563] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-11 22:55:03,329 DEBUG [Listener at localhost.localdomain/41563] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-11 22:55:03,335 INFO [Listener at localhost.localdomain/41563] client.HBaseAdmin$15(890): Started disable of testCompactionWithHFileLink 2023-03-11 22:55:03,335 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testCompactionWithHFileLink 2023-03-11 22:55:03,336 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure2.ProcedureExecutor(1029): Stored pid=88, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testCompactionWithHFileLink 2023-03-11 22:55:03,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1227): Checking to see if procedure is done pid=88 2023-03-11 22:55:03,338 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678575303338"}]},"ts":"1678575303338"} 2023-03-11 22:55:03,339 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=DISABLING in hbase:meta 2023-03-11 22:55:03,340 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testCompactionWithHFileLink to state=DISABLING 2023-03-11 22:55:03,340 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=89, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f5ff2dc2c8d65f11f0ecb2681def8a43, UNASSIGN}, {pid=90, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=c9557b829346f7133c6ea3c6c1b42236, UNASSIGN}, {pid=91, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=7189059ae0acaaffd2a7e63414af38f7, UNASSIGN}] 2023-03-11 22:55:03,341 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=89, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f5ff2dc2c8d65f11f0ecb2681def8a43, UNASSIGN 2023-03-11 22:55:03,342 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=7189059ae0acaaffd2a7e63414af38f7, UNASSIGN 2023-03-11 22:55:03,342 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=90, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=c9557b829346f7133c6ea3c6c1b42236, UNASSIGN 2023-03-11 22:55:03,342 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=c9557b829346f7133c6ea3c6c1b42236, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:03,342 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=7189059ae0acaaffd2a7e63414af38f7, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:03,342 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=89 updating hbase:meta row=f5ff2dc2c8d65f11f0ecb2681def8a43, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:03,342 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1678575280100.c9557b829346f7133c6ea3c6c1b42236.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1678575303342"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1678575303342"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678575303342"}]},"ts":"1678575303342"} 2023-03-11 22:55:03,342 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1678575280100.7189059ae0acaaffd2a7e63414af38f7.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1678575303342"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1678575303342"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678575303342"}]},"ts":"1678575303342"} 2023-03-11 22:55:03,342 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1678575280100.f5ff2dc2c8d65f11f0ecb2681def8a43.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1678575303342"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1678575303342"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678575303342"}]},"ts":"1678575303342"} 2023-03-11 22:55:03,343 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=92, ppid=90, state=RUNNABLE; CloseRegionProcedure c9557b829346f7133c6ea3c6c1b42236, server=jenkins-hbase20.apache.org,41843,1678575183185}] 2023-03-11 22:55:03,344 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=91, state=RUNNABLE; CloseRegionProcedure 7189059ae0acaaffd2a7e63414af38f7, server=jenkins-hbase20.apache.org,41843,1678575183185}] 2023-03-11 22:55:03,344 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=89, state=RUNNABLE; CloseRegionProcedure f5ff2dc2c8d65f11f0ecb2681def8a43, server=jenkins-hbase20.apache.org,41843,1678575183185}] 2023-03-11 22:55:03,439 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1227): Checking to see if procedure is done pid=88 2023-03-11 22:55:03,495 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close f5ff2dc2c8d65f11f0ecb2681def8a43 2023-03-11 22:55:03,495 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing f5ff2dc2c8d65f11f0ecb2681def8a43, disabling compactions & flushes 2023-03-11 22:55:03,496 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1678575280100.f5ff2dc2c8d65f11f0ecb2681def8a43. 2023-03-11 22:55:03,496 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1678575280100.f5ff2dc2c8d65f11f0ecb2681def8a43. 2023-03-11 22:55:03,496 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1678575280100.f5ff2dc2c8d65f11f0ecb2681def8a43. after waiting 0 ms 2023-03-11 22:55:03,496 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1678575280100.f5ff2dc2c8d65f11f0ecb2681def8a43. 2023-03-11 22:55:03,505 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-03-11 22:55:03,507 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1678575280100.f5ff2dc2c8d65f11f0ecb2681def8a43. 2023-03-11 22:55:03,508 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for f5ff2dc2c8d65f11f0ecb2681def8a43: 2023-03-11 22:55:03,511 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed f5ff2dc2c8d65f11f0ecb2681def8a43 2023-03-11 22:55:03,511 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close c9557b829346f7133c6ea3c6c1b42236 2023-03-11 22:55:03,511 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing c9557b829346f7133c6ea3c6c1b42236, disabling compactions & flushes 2023-03-11 22:55:03,511 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1678575280100.c9557b829346f7133c6ea3c6c1b42236. 2023-03-11 22:55:03,511 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1678575280100.c9557b829346f7133c6ea3c6c1b42236. 2023-03-11 22:55:03,511 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1678575280100.c9557b829346f7133c6ea3c6c1b42236. after waiting 0 ms 2023-03-11 22:55:03,512 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1678575280100.c9557b829346f7133c6ea3c6c1b42236. 2023-03-11 22:55:03,512 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=89 updating hbase:meta row=f5ff2dc2c8d65f11f0ecb2681def8a43, regionState=CLOSED 2023-03-11 22:55:03,512 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1678575280100.f5ff2dc2c8d65f11f0ecb2681def8a43.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1678575303512"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678575303512"}]},"ts":"1678575303512"} 2023-03-11 22:55:03,516 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=89 2023-03-11 22:55:03,516 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=89, state=SUCCESS; CloseRegionProcedure f5ff2dc2c8d65f11f0ecb2681def8a43, server=jenkins-hbase20.apache.org,41843,1678575183185 in 170 msec 2023-03-11 22:55:03,517 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=89, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f5ff2dc2c8d65f11f0ecb2681def8a43, UNASSIGN in 176 msec 2023-03-11 22:55:03,517 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-03-11 22:55:03,519 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1678575280100.c9557b829346f7133c6ea3c6c1b42236. 2023-03-11 22:55:03,519 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for c9557b829346f7133c6ea3c6c1b42236: 2023-03-11 22:55:03,520 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed c9557b829346f7133c6ea3c6c1b42236 2023-03-11 22:55:03,520 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close 7189059ae0acaaffd2a7e63414af38f7 2023-03-11 22:55:03,520 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 7189059ae0acaaffd2a7e63414af38f7, disabling compactions & flushes 2023-03-11 22:55:03,521 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1678575280100.7189059ae0acaaffd2a7e63414af38f7. 2023-03-11 22:55:03,521 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1678575280100.7189059ae0acaaffd2a7e63414af38f7. 2023-03-11 22:55:03,521 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1678575280100.7189059ae0acaaffd2a7e63414af38f7. after waiting 0 ms 2023-03-11 22:55:03,521 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=c9557b829346f7133c6ea3c6c1b42236, regionState=CLOSED 2023-03-11 22:55:03,521 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1678575280100.7189059ae0acaaffd2a7e63414af38f7. 2023-03-11 22:55:03,521 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1678575280100.c9557b829346f7133c6ea3c6c1b42236.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1678575303521"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678575303521"}]},"ts":"1678575303521"} 2023-03-11 22:55:03,524 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=92, resume processing ppid=90 2023-03-11 22:55:03,524 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; CloseRegionProcedure c9557b829346f7133c6ea3c6c1b42236, server=jenkins-hbase20.apache.org,41843,1678575183185 in 180 msec 2023-03-11 22:55:03,525 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=90, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=c9557b829346f7133c6ea3c6c1b42236, UNASSIGN in 184 msec 2023-03-11 22:55:03,526 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-03-11 22:55:03,527 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1678575280100.7189059ae0acaaffd2a7e63414af38f7. 2023-03-11 22:55:03,527 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 7189059ae0acaaffd2a7e63414af38f7: 2023-03-11 22:55:03,528 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed 7189059ae0acaaffd2a7e63414af38f7 2023-03-11 22:55:03,528 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=7189059ae0acaaffd2a7e63414af38f7, regionState=CLOSED 2023-03-11 22:55:03,529 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1678575280100.7189059ae0acaaffd2a7e63414af38f7.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1678575303528"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678575303528"}]},"ts":"1678575303528"} 2023-03-11 22:55:03,531 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=91 2023-03-11 22:55:03,532 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=91, state=SUCCESS; CloseRegionProcedure 7189059ae0acaaffd2a7e63414af38f7, server=jenkins-hbase20.apache.org,41843,1678575183185 in 186 msec 2023-03-11 22:55:03,533 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=91, resume processing ppid=88 2023-03-11 22:55:03,533 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=7189059ae0acaaffd2a7e63414af38f7, UNASSIGN in 192 msec 2023-03-11 22:55:03,534 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678575303534"}]},"ts":"1678575303534"} 2023-03-11 22:55:03,535 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=DISABLED in hbase:meta 2023-03-11 22:55:03,536 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testCompactionWithHFileLink to state=DISABLED 2023-03-11 22:55:03,538 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=88, state=SUCCESS; DisableTableProcedure table=testCompactionWithHFileLink in 202 msec 2023-03-11 22:55:03,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1227): Checking to see if procedure is done pid=88 2023-03-11 22:55:03,642 INFO [Listener at localhost.localdomain/41563] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testCompactionWithHFileLink, procId: 88 completed 2023-03-11 22:55:03,657 INFO [Listener at localhost.localdomain/41563] client.HBaseAdmin(2586): Taking restore-failsafe snapshot: hbase-failsafe-snaptb-1678575289115-1678575303657 2023-03-11 22:55:03,658 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1580): Client=jenkins//148.251.75.209 snapshot request for:{ ss=hbase-failsafe-snaptb-1678575289115-1678575303657 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-03-11 22:55:03,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1678575303658 (current time:1678575303658). 2023-03-11 22:55:03,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-03-11 22:55:03,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] zookeeper.ReadOnlyZKClient(139): Connect 0x3eaca7d4 to 127.0.0.1:51815 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-11 22:55:03,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@15cc87ad, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-11 22:55:03,663 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-11 22:55:03,665 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:55084, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-11 22:55:03,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3eaca7d4 to 127.0.0.1:51815 2023-03-11 22:55:03,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-11 22:55:03,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-03-11 22:55:03,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] snapshot.SnapshotManager(659): Table is disabled, running snapshot entirely on master for { ss=hbase-failsafe-snaptb-1678575289115-1678575303657 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-03-11 22:55:03,668 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-03-11 22:55:03,669 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-03-11 22:55:03,669 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE; timeout=600000, timestamp=1678575903669 2023-03-11 22:55:03,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] snapshot.SnapshotManager(664): Started snapshot: { ss=hbase-failsafe-snaptb-1678575289115-1678575303657 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-03-11 22:55:03,669 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running DISABLED table snapshot hbase-failsafe-snaptb-1678575289115-1678575303657 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink 2023-03-11 22:55:03,669 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=hbase-failsafe-snaptb-1678575289115-1678575303657 table=testCompactionWithHFileLink type=FLUSH ttl=0 }'' to complete. (max 300000 ms per retry) 2023-03-11 22:55:03,669 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-03-11 22:55:03,770 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-11 22:55:03,772 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1678575289115-1678575303657 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-11 22:55:03,772 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1678575289115-1678575303657 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-03-11 22:55:03,773 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-03-11 22:55:03,973 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-11 22:55:03,975 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1678575289115-1678575303657 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-11 22:55:03,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1678575289115-1678575303657 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-03-11 22:55:03,976 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-03-11 22:55:04,080 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.DisabledTableSnapshotHandler(97): Starting to write region info and WALs for regions for offline snapshot:{ ss=hbase-failsafe-snaptb-1678575289115-1678575303657 table=testCompactionWithHFileLink type=DISABLED ttl=0 } 2023-03-11 22:55:04,084 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-03-11 22:55:04,084 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-03-11 22:55:04,084 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-03-11 22:55:04,084 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-03-11 22:55:04,084 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-03-11 22:55:04,085 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-03-11 22:55:04,085 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-03-11 22:55:04,085 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-03-11 22:55:04,088 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family1/77c90167913a49e2af7992e59f7224fe_SeqId_29_, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family1/7a89d096daf54b56b976023e29c42366] hfiles 2023-03-11 22:55:04,088 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family1/77c90167913a49e2af7992e59f7224fe_SeqId_29_ 2023-03-11 22:55:04,088 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family1/7a89d096daf54b56b976023e29c42366 2023-03-11 22:55:04,088 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family1/1fc9e5c06c9d4fb29770ae280e0281cc, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family1/38dac416abb34db6b30e0c2fd51a45db_SeqId_29_] hfiles 2023-03-11 22:55:04,088 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family1/1fc9e5c06c9d4fb29770ae280e0281cc 2023-03-11 22:55:04,088 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family1/38dac416abb34db6b30e0c2fd51a45db_SeqId_29_ 2023-03-11 22:55:04,088 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family1/4813388373f14c4ea377a261e7d8f572_SeqId_29_, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family1/da87c83f7d9d463e8da03c4222912e64] hfiles 2023-03-11 22:55:04,089 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family1/4813388373f14c4ea377a261e7d8f572_SeqId_29_ 2023-03-11 22:55:04,089 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230311565649dea7d9497393be98f96c7c338d, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202303112ee4409db62d4336888f5681542cfc52, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230311c6faf1b70fbb43c1bcecb3ed6946fcf2] hfiles 2023-03-11 22:55:04,089 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family1/da87c83f7d9d463e8da03c4222912e64 2023-03-11 22:55:04,089 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (1/3): hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230311565649dea7d9497393be98f96c7c338d 2023-03-11 22:55:04,089 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (2/3): hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202303112ee4409db62d4336888f5681542cfc52 2023-03-11 22:55:04,089 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (3/3): hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230311c6faf1b70fbb43c1bcecb3ed6946fcf2 2023-03-11 22:55:04,089 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family2/34a21d0962fd4f67babe633e97f868d7] hfiles 2023-03-11 22:55:04,089 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family2/8183e16b74a54227a197dcb65759111e] hfiles 2023-03-11 22:55:04,089 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family2/34a21d0962fd4f67babe633e97f868d7 2023-03-11 22:55:04,089 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family2/8183e16b74a54227a197dcb65759111e 2023-03-11 22:55:04,089 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family2/06271d10502949f8acccb38636334d64] hfiles 2023-03-11 22:55:04,089 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family2/06271d10502949f8acccb38636334d64 2023-03-11 22:55:04,095 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202303111592aab81cfb4f39a69a641c21ccc611, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202303112e82ff8048a34eeca5e178fe8ced73eb, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202303113e6629ce680c49dea38070747438fc75, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230311ab679c8580b747129707b59c422a1364, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230311afe2940811f543c093d0b2e76a766c62_del, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202303111fb665807e7c4ca1ae12fef6db1004d4, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023031120f2f8b5571042b2847c9bc8db048105, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202303113056fe9b988046309ed8e7ae7ceb4086, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230311559d25fc53c04f738cdf9dcbd65a3dba, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023031190986fdb672a4e2b8c0e4c7d39c62715_del, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202303113fe2648247a94d5b8601a376956599d5_del, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202303118e7d78be23434c5fb4fc0045235c5514, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230311a5761f8506244c52b5425d6325f21461, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230311bd6add52e77a495cb451a1c9ec966c72, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230311ed610082841a44f4a2bf291974d056cb] hfiles 2023-03-11 22:55:04,095 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (1/15): hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202303111592aab81cfb4f39a69a641c21ccc611 2023-03-11 22:55:04,095 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (2/15): hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202303112e82ff8048a34eeca5e178fe8ced73eb 2023-03-11 22:55:04,095 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (3/15): hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202303113e6629ce680c49dea38070747438fc75 2023-03-11 22:55:04,095 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (4/15): hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230311ab679c8580b747129707b59c422a1364 2023-03-11 22:55:04,095 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (5/15): hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230311afe2940811f543c093d0b2e76a766c62_del 2023-03-11 22:55:04,095 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (6/15): hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202303111fb665807e7c4ca1ae12fef6db1004d4 2023-03-11 22:55:04,095 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (7/15): hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023031120f2f8b5571042b2847c9bc8db048105 2023-03-11 22:55:04,095 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (8/15): hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202303113056fe9b988046309ed8e7ae7ceb4086 2023-03-11 22:55:04,095 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (9/15): hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230311559d25fc53c04f738cdf9dcbd65a3dba 2023-03-11 22:55:04,095 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (10/15): hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023031190986fdb672a4e2b8c0e4c7d39c62715_del 2023-03-11 22:55:04,095 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (11/15): hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202303113fe2648247a94d5b8601a376956599d5_del 2023-03-11 22:55:04,095 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (12/15): hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202303118e7d78be23434c5fb4fc0045235c5514 2023-03-11 22:55:04,095 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (13/15): hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230311a5761f8506244c52b5425d6325f21461 2023-03-11 22:55:04,095 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (14/15): hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230311bd6add52e77a495cb451a1c9ec966c72 2023-03-11 22:55:04,095 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (15/15): hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230311ed610082841a44f4a2bf291974d056cb 2023-03-11 22:55:04,277 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-11 22:55:04,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1678575289115-1678575303657 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-11 22:55:04,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1678575289115-1678575303657 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-03-11 22:55:04,280 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-03-11 22:55:04,500 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.DisabledTableSnapshotHandler(120): Marking snapshot{ ss=hbase-failsafe-snaptb-1678575289115-1678575303657 table=testCompactionWithHFileLink type=DISABLED ttl=0 } as finished. 2023-03-11 22:55:04,500 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for hbase-failsafe-snaptb-1678575289115-1678575303657 2023-03-11 22:55:04,501 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1678575289115-1678575303657 2023-03-11 22:55:04,566 DEBUG [regionserver/jenkins-hbase20:0.Chore.1] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.0, tune throughput to 50.00 MB/second 2023-03-11 22:55:04,780 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-11 22:55:04,782 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1678575289115-1678575303657 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-11 22:55:04,782 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1678575289115-1678575303657 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-03-11 22:55:04,783 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-03-11 22:55:04,934 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1678575289115-1678575303657 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/.hbase-snapshot/hbase-failsafe-snaptb-1678575289115-1678575303657 2023-03-11 22:55:05,749 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot hbase-failsafe-snaptb-1678575289115-1678575303657 of table testCompactionWithHFileLink completed 2023-03-11 22:55:05,749 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1678575289115-1678575303657 2023-03-11 22:55:05,750 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1678575289115-1678575303657 2023-03-11 22:55:05,750 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running DISABLED table snapshot hbase-failsafe-snaptb-1678575289115-1678575303657 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink at 1678575303669Starting to write region info and WALs for regions for offline snapshot:{ ss=hbase-failsafe-snaptb-1678575289115-1678575303657 table=testCompactionWithHFileLink type=DISABLED ttl=0 } at 1678575304080 (+411 ms)Consolidate snapshot: hbase-failsafe-snaptb-1678575289115-1678575303657 at 1678575304500 (+420 ms)Loading Region manifests for hbase-failsafe-snaptb-1678575289115-1678575303657 at 1678575304500Writing data manifest for hbase-failsafe-snaptb-1678575289115-1678575303657 at 1678575304505 (+5 ms)Verifying snapshot: hbase-failsafe-snaptb-1678575289115-1678575303657 at 1678575304916 (+411 ms)Snapshot hbase-failsafe-snaptb-1678575289115-1678575303657 of table testCompactionWithHFileLink completed at 1678575305749 (+833 ms) 2023-03-11 22:55:05,750 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-03-11 22:55:05,752 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE in 2.0830 sec 2023-03-11 22:55:05,783 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-11 22:55:05,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1678575289115-1678575303657 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-11 22:55:05,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] snapshot.SnapshotManager(401): Snapshot '{ ss=hbase-failsafe-snaptb-1678575289115-1678575303657 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' has completed, notifying client. 2023-03-11 22:55:05,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE:RESTORE_SNAPSHOT_PRE_OPERATION; RestoreSnapshotProcedure (table=testCompactionWithHFileLink snapshot=name: "snaptb-1678575289115" table: "testCompactionWithHFileLink" creation_time: 1678575289130 type: FLUSH version: 2 ttl: 0 ) 2023-03-11 22:55:05,817 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] snapshot.SnapshotManager(880): Restore snapshot=snaptb-1678575289115 as table=testCompactionWithHFileLink 2023-03-11 22:55:05,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1227): Checking to see if procedure is done pid=96 2023-03-11 22:55:05,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1227): Checking to see if procedure is done pid=96 2023-03-11 22:55:06,121 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1227): Checking to see if procedure is done pid=96 2023-03-11 22:55:06,227 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000002 2023-03-11 22:55:06,229 DEBUG [PEWorker-3] util.FSTableDescriptors(519): Deleted hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000001 2023-03-11 22:55:06,229 INFO [PEWorker-3] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000002 2023-03-11 22:55:06,231 INFO [PEWorker-3] procedure.RestoreSnapshotProcedure(374): Starting restore snapshot={ ss=snaptb-1678575289115 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-03-11 22:55:06,237 INFO [PEWorker-3] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "snaptb-1678575289115" table: "testCompactionWithHFileLink" creation_time: 1678575289130 type: FLUSH version: 2 ttl: 0 2023-03-11 22:55:06,238 DEBUG [PEWorker-3] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink 2023-03-11 22:55:06,242 DEBUG [PEWorker-3] snapshot.RestoreSnapshotHelper(797): found 3 regions for table=testCompactionWithHFileLink 2023-03-11 22:55:06,245 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202303112ee4409db62d4336888f5681542cfc52 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202303112ee4409db62d4336888f5681542cfc52 2023-03-11 22:55:06,246 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230311565649dea7d9497393be98f96c7c338d to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230311565649dea7d9497393be98f96c7c338d 2023-03-11 22:55:06,248 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230311c6faf1b70fbb43c1bcecb3ed6946fcf2 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230311c6faf1b70fbb43c1bcecb3ed6946fcf2 2023-03-11 22:55:06,248 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b202303118527fef18c5e485c949f1cd3a30c3aaa of snapshot=snaptb-1678575289115 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-11 22:55:06,251 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20230311a27e4a83b27c4b30b2875268932f5f96 of snapshot=snaptb-1678575289115 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-11 22:55:06,254 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20230311d39059d225114219bb95e51a3bf73129 of snapshot=snaptb-1678575289115 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-11 22:55:06,256 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20230311ecd72b1e22a74ca4941b5e1642c89708 of snapshot=snaptb-1678575289115 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-11 22:55:06,259 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c202303112d52c5edbd894361b1998c4735e4a082 of snapshot=snaptb-1678575289115 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-11 22:55:06,262 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c202303117cac817e46b249e58838f77e044220eb of snapshot=snaptb-1678575289115 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-11 22:55:06,265 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c202303119e2f565be17f40a48d173fb84aee091c of snapshot=snaptb-1678575289115 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-11 22:55:06,268 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20230311e5edfb7e86044da99c8e8fc0b0d075d5 of snapshot=snaptb-1678575289115 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-11 22:55:06,271 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e202303113fc32ad601054ce383d790ba61e9b1d9 of snapshot=snaptb-1678575289115 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-11 22:55:06,273 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e202303119f211bc34e194a71bf189bd5baf45037 of snapshot=snaptb-1678575289115 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-11 22:55:06,276 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e20230311eadcedaacb5d4629984edc323cb2ca58 of snapshot=snaptb-1678575289115 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-11 22:55:06,280 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e20230311f3e1642b0eae497e8943343bd9127843 of snapshot=snaptb-1678575289115 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-11 22:55:06,285 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230311afe2940811f543c093d0b2e76a766c62_del to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230311afe2940811f543c093d0b2e76a766c62_del 2023-03-11 22:55:06,287 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202303113fe2648247a94d5b8601a376956599d5_del to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202303113fe2648247a94d5b8601a376956599d5_del 2023-03-11 22:55:06,288 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023031190986fdb672a4e2b8c0e4c7d39c62715_del to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023031190986fdb672a4e2b8c0e4c7d39c62715_del 2023-03-11 22:55:06,288 INFO [PEWorker-3] snapshot.RestoreSnapshotHelper(223): region to restore: 7189059ae0acaaffd2a7e63414af38f7 2023-03-11 22:55:06,288 INFO [PEWorker-3] snapshot.RestoreSnapshotHelper(223): region to restore: c9557b829346f7133c6ea3c6c1b42236 2023-03-11 22:55:06,288 INFO [PEWorker-3] snapshot.RestoreSnapshotHelper(223): region to restore: f5ff2dc2c8d65f11f0ecb2681def8a43 2023-03-11 22:55:06,291 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family1/7a89d096daf54b56b976023e29c42366 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family1/7a89d096daf54b56b976023e29c42366 2023-03-11 22:55:06,291 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family1/1fc9e5c06c9d4fb29770ae280e0281cc to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family1/1fc9e5c06c9d4fb29770ae280e0281cc 2023-03-11 22:55:06,291 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family1/4813388373f14c4ea377a261e7d8f572_SeqId_29_ to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family1/4813388373f14c4ea377a261e7d8f572_SeqId_29_ 2023-03-11 22:55:06,292 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family1/77c90167913a49e2af7992e59f7224fe_SeqId_29_ to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family1/77c90167913a49e2af7992e59f7224fe_SeqId_29_ 2023-03-11 22:55:06,292 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink b71bc618951c43e69e774b42be4b0bef of snapshot=snaptb-1678575289115 to region=f5ff2dc2c8d65f11f0ecb2681def8a43 table=testCompactionWithHFileLink 2023-03-11 22:55:06,293 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family1/38dac416abb34db6b30e0c2fd51a45db_SeqId_29_ to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family1/38dac416abb34db6b30e0c2fd51a45db_SeqId_29_ 2023-03-11 22:55:06,293 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink bd42d7e392e844e2a435e9965bbe4b52 of snapshot=snaptb-1678575289115 to region=7189059ae0acaaffd2a7e63414af38f7 table=testCompactionWithHFileLink 2023-03-11 22:55:06,293 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family1/da87c83f7d9d463e8da03c4222912e64 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family1/da87c83f7d9d463e8da03c4222912e64 2023-03-11 22:55:06,293 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink de777f4aa41a4d8fb92468da0d003d99 of snapshot=snaptb-1678575289115 to region=c9557b829346f7133c6ea3c6c1b42236 table=testCompactionWithHFileLink 2023-03-11 22:55:06,306 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 501392378a5d499b90c1edfbc30e4277 of snapshot=snaptb-1678575289115 to region=c9557b829346f7133c6ea3c6c1b42236 table=testCompactionWithHFileLink 2023-03-11 22:55:06,306 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 6dcf1deb771d4f1684637d7e9f23839d of snapshot=snaptb-1678575289115 to region=f5ff2dc2c8d65f11f0ecb2681def8a43 table=testCompactionWithHFileLink 2023-03-11 22:55:06,306 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 792b51b4e7344f2bb05423e36d8dccac of snapshot=snaptb-1678575289115 to region=7189059ae0acaaffd2a7e63414af38f7 table=testCompactionWithHFileLink 2023-03-11 22:55:06,308 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink a2c8cd3ba10746a5857f359843a355cb of snapshot=snaptb-1678575289115 to region=f5ff2dc2c8d65f11f0ecb2681def8a43 table=testCompactionWithHFileLink 2023-03-11 22:55:06,308 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 18bc795cc708409888f506cea46a1ceb of snapshot=snaptb-1678575289115 to region=c9557b829346f7133c6ea3c6c1b42236 table=testCompactionWithHFileLink 2023-03-11 22:55:06,309 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 70a13ebdab6744bb8dd47dd67237f4ca of snapshot=snaptb-1678575289115 to region=7189059ae0acaaffd2a7e63414af38f7 table=testCompactionWithHFileLink 2023-03-11 22:55:06,311 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 7da2cf4d34844cb08bfda2f1981a5aa3 of snapshot=snaptb-1678575289115 to region=f5ff2dc2c8d65f11f0ecb2681def8a43 table=testCompactionWithHFileLink 2023-03-11 22:55:06,311 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d4a76178692149918ee59f0c53bd768e of snapshot=snaptb-1678575289115 to region=c9557b829346f7133c6ea3c6c1b42236 table=testCompactionWithHFileLink 2023-03-11 22:55:06,311 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 043642cf5ff64bcfbb11167818921f2a of snapshot=snaptb-1678575289115 to region=7189059ae0acaaffd2a7e63414af38f7 table=testCompactionWithHFileLink 2023-03-11 22:55:06,316 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family2/06271d10502949f8acccb38636334d64 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family2/06271d10502949f8acccb38636334d64 2023-03-11 22:55:06,316 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink f0aea611a01547acbf71afe50f36b56e of snapshot=snaptb-1678575289115 to region=c9557b829346f7133c6ea3c6c1b42236 table=testCompactionWithHFileLink 2023-03-11 22:55:06,316 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family2/34a21d0962fd4f67babe633e97f868d7 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family2/34a21d0962fd4f67babe633e97f868d7 2023-03-11 22:55:06,316 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 56a3feebc66c4f1b84e6eae2fe9cef71 of snapshot=snaptb-1678575289115 to region=f5ff2dc2c8d65f11f0ecb2681def8a43 table=testCompactionWithHFileLink 2023-03-11 22:55:06,316 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family2/8183e16b74a54227a197dcb65759111e to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family2/8183e16b74a54227a197dcb65759111e 2023-03-11 22:55:06,317 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 85d83795bb82460c9e80c58c7c9ee030 of snapshot=snaptb-1678575289115 to region=7189059ae0acaaffd2a7e63414af38f7 table=testCompactionWithHFileLink 2023-03-11 22:55:06,321 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 08c74fbf215e40af9afa551a84198fdc of snapshot=snaptb-1678575289115 to region=c9557b829346f7133c6ea3c6c1b42236 table=testCompactionWithHFileLink 2023-03-11 22:55:06,321 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 9811e2f543154038a3c389b2b7bae676 of snapshot=snaptb-1678575289115 to region=f5ff2dc2c8d65f11f0ecb2681def8a43 table=testCompactionWithHFileLink 2023-03-11 22:55:06,322 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 22a1925811b2401c869aa7abba4e22f2 of snapshot=snaptb-1678575289115 to region=7189059ae0acaaffd2a7e63414af38f7 table=testCompactionWithHFileLink 2023-03-11 22:55:06,323 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink f8c70657fdc84511b043d1760c4a13b4 of snapshot=snaptb-1678575289115 to region=c9557b829346f7133c6ea3c6c1b42236 table=testCompactionWithHFileLink 2023-03-11 22:55:06,324 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 79ebb06592894586af3575e3868c1041 of snapshot=snaptb-1678575289115 to region=f5ff2dc2c8d65f11f0ecb2681def8a43 table=testCompactionWithHFileLink 2023-03-11 22:55:06,324 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 55033e843476407d82f5c58e2a278d03 of snapshot=snaptb-1678575289115 to region=7189059ae0acaaffd2a7e63414af38f7 table=testCompactionWithHFileLink 2023-03-11 22:55:06,326 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 03ba98a6910540ec9e47b184aac49932 of snapshot=snaptb-1678575289115 to region=c9557b829346f7133c6ea3c6c1b42236 table=testCompactionWithHFileLink 2023-03-11 22:55:06,327 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 3968f87f78914e98a705a9c15c526df6 of snapshot=snaptb-1678575289115 to region=f5ff2dc2c8d65f11f0ecb2681def8a43 table=testCompactionWithHFileLink 2023-03-11 22:55:06,327 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 75664672bae7473c96efa0a98a865614 of snapshot=snaptb-1678575289115 to region=7189059ae0acaaffd2a7e63414af38f7 table=testCompactionWithHFileLink 2023-03-11 22:55:06,329 INFO [PEWorker-3] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "snaptb-1678575289115" table: "testCompactionWithHFileLink" creation_time: 1678575289130 type: FLUSH version: 2 ttl: 0 2023-03-11 22:55:06,330 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,2,1678575280100.7189059ae0acaaffd2a7e63414af38f7.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1678575306330"}]},"ts":"9223372036854775807"} 2023-03-11 22:55:06,330 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,1,1678575280100.c9557b829346f7133c6ea3c6c1b42236.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1678575306330"}]},"ts":"9223372036854775807"} 2023-03-11 22:55:06,330 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,,1678575280100.f5ff2dc2c8d65f11f0ecb2681def8a43.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1678575306330"}]},"ts":"9223372036854775807"} 2023-03-11 22:55:06,332 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 3 regions from META 2023-03-11 22:55:06,332 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 7189059ae0acaaffd2a7e63414af38f7, NAME => 'testCompactionWithHFileLink,2,1678575280100.7189059ae0acaaffd2a7e63414af38f7.', STARTKEY => '2', ENDKEY => ''}, {ENCODED => c9557b829346f7133c6ea3c6c1b42236, NAME => 'testCompactionWithHFileLink,1,1678575280100.c9557b829346f7133c6ea3c6c1b42236.', STARTKEY => '1', ENDKEY => '2'}, {ENCODED => f5ff2dc2c8d65f11f0ecb2681def8a43, NAME => 'testCompactionWithHFileLink,,1678575280100.f5ff2dc2c8d65f11f0ecb2681def8a43.', STARTKEY => '', ENDKEY => '1'}] 2023-03-11 22:55:06,332 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1678575280100.7189059ae0acaaffd2a7e63414af38f7.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1678575306331"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678575306331"}]},"ts":"1678575306331"} 2023-03-11 22:55:06,332 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1678575280100.c9557b829346f7133c6ea3c6c1b42236.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1678575306331"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678575306331"}]},"ts":"1678575306331"} 2023-03-11 22:55:06,332 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1678575280100.f5ff2dc2c8d65f11f0ecb2681def8a43.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1678575306331"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678575306331"}]},"ts":"1678575306331"} 2023-03-11 22:55:06,333 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-03-11 22:55:06,333 INFO [PEWorker-3] hbase.MetaTableAccessor(1810): Overwritten 3 regions to Meta 2023-03-11 22:55:06,333 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1811): Overwritten regions: [{ENCODED => 7189059ae0acaaffd2a7e63414af38f7, NAME => 'testCompactionWithHFileLink,2,1678575280100.7189059ae0acaaffd2a7e63414af38f7.', STARTKEY => '2', ENDKEY => ''}, {ENCODED => c9557b829346f7133c6ea3c6c1b42236, NAME => 'testCompactionWithHFileLink,1,1678575280100.c9557b829346f7133c6ea3c6c1b42236.', STARTKEY => '1', ENDKEY => '2'}, {ENCODED => f5ff2dc2c8d65f11f0ecb2681def8a43, NAME => 'testCompactionWithHFileLink,,1678575280100.f5ff2dc2c8d65f11f0ecb2681def8a43.', STARTKEY => '', ENDKEY => '1'}] 2023-03-11 22:55:06,334 INFO [PEWorker-3] procedure.RestoreSnapshotProcedure(447): Restore snapshot={ ss=snaptb-1678575289115 table=testCompactionWithHFileLink type=FLUSH ttl=0 } on table=testCompactionWithHFileLink completed! 2023-03-11 22:55:06,335 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; RestoreSnapshotProcedure (table=testCompactionWithHFileLink snapshot=name: "snaptb-1678575289115" table: "testCompactionWithHFileLink" creation_time: 1678575289130 type: FLUSH version: 2 ttl: 0 ) in 525 msec 2023-03-11 22:55:06,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1227): Checking to see if procedure is done pid=96 2023-03-11 22:55:06,424 INFO [Listener at localhost.localdomain/41563] client.HBaseAdmin$TableFuture(3541): Operation: MODIFY, Table Name: default:testCompactionWithHFileLink, procId: 96 completed 2023-03-11 22:55:06,424 INFO [Listener at localhost.localdomain/41563] client.HBaseAdmin(2618): Deleting restore-failsafe snapshot: hbase-failsafe-snaptb-1678575289115-1678575303657 2023-03-11 22:55:06,433 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(748): Client=jenkins//148.251.75.209 delete name: "hbase-failsafe-snaptb-1678575289115-1678575303657" 2023-03-11 22:55:06,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] snapshot.SnapshotManager(333): Deleting snapshot: hbase-failsafe-snaptb-1678575289115-1678575303657 2023-03-11 22:55:06,442 INFO [Listener at localhost.localdomain/41563] client.HBaseAdmin$14(830): Started enable of testCompactionWithHFileLink 2023-03-11 22:55:06,446 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.HMaster$10(2385): Client=jenkins//148.251.75.209 enable testCompactionWithHFileLink 2023-03-11 22:55:06,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE:ENABLE_TABLE_PREPARE; EnableTableProcedure table=testCompactionWithHFileLink 2023-03-11 22:55:06,456 INFO [PEWorker-2] procedure.EnableTableProcedure(296): Attempting to enable the table testCompactionWithHFileLink 2023-03-11 22:55:06,457 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678575306456"}]},"ts":"1678575306456"} 2023-03-11 22:55:06,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-03-11 22:55:06,458 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLING in hbase:meta 2023-03-11 22:55:06,460 DEBUG [PEWorker-2] procedure.EnableTableProcedure(107): No change in number of region replicas (configuredReplicaCount=1); assigning. 2023-03-11 22:55:06,460 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f5ff2dc2c8d65f11f0ecb2681def8a43, ASSIGN}, {pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=c9557b829346f7133c6ea3c6c1b42236, ASSIGN}, {pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=7189059ae0acaaffd2a7e63414af38f7, ASSIGN}] 2023-03-11 22:55:06,461 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=c9557b829346f7133c6ea3c6c1b42236, ASSIGN 2023-03-11 22:55:06,461 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=7189059ae0acaaffd2a7e63414af38f7, ASSIGN 2023-03-11 22:55:06,461 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f5ff2dc2c8d65f11f0ecb2681def8a43, ASSIGN 2023-03-11 22:55:06,462 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=c9557b829346f7133c6ea3c6c1b42236, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-03-11 22:55:06,462 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=7189059ae0acaaffd2a7e63414af38f7, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-03-11 22:55:06,462 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f5ff2dc2c8d65f11f0ecb2681def8a43, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-03-11 22:55:06,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-03-11 22:55:06,613 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=7189059ae0acaaffd2a7e63414af38f7, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:06,613 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=f5ff2dc2c8d65f11f0ecb2681def8a43, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:06,613 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1678575280100.7189059ae0acaaffd2a7e63414af38f7.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1678575306613"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1678575306613"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678575306613"}]},"ts":"1678575306613"} 2023-03-11 22:55:06,613 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=c9557b829346f7133c6ea3c6c1b42236, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:06,614 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1678575280100.f5ff2dc2c8d65f11f0ecb2681def8a43.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1678575306613"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1678575306613"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678575306613"}]},"ts":"1678575306613"} 2023-03-11 22:55:06,614 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1678575280100.c9557b829346f7133c6ea3c6c1b42236.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1678575306613"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1678575306613"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678575306613"}]},"ts":"1678575306613"} 2023-03-11 22:55:06,615 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=101, ppid=100, state=RUNNABLE; OpenRegionProcedure 7189059ae0acaaffd2a7e63414af38f7, server=jenkins-hbase20.apache.org,41843,1678575183185}] 2023-03-11 22:55:06,615 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=98, state=RUNNABLE; OpenRegionProcedure f5ff2dc2c8d65f11f0ecb2681def8a43, server=jenkins-hbase20.apache.org,41843,1678575183185}] 2023-03-11 22:55:06,616 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=99, state=RUNNABLE; OpenRegionProcedure c9557b829346f7133c6ea3c6c1b42236, server=jenkins-hbase20.apache.org,41843,1678575183185}] 2023-03-11 22:55:06,760 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-03-11 22:55:06,771 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,,1678575280100.f5ff2dc2c8d65f11f0ecb2681def8a43. 2023-03-11 22:55:06,771 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f5ff2dc2c8d65f11f0ecb2681def8a43, NAME => 'testCompactionWithHFileLink,,1678575280100.f5ff2dc2c8d65f11f0ecb2681def8a43.', STARTKEY => '', ENDKEY => '1'} 2023-03-11 22:55:06,771 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink f5ff2dc2c8d65f11f0ecb2681def8a43 2023-03-11 22:55:06,772 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1678575280100.f5ff2dc2c8d65f11f0ecb2681def8a43.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-11 22:55:06,772 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for f5ff2dc2c8d65f11f0ecb2681def8a43 2023-03-11 22:55:06,772 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for f5ff2dc2c8d65f11f0ecb2681def8a43 2023-03-11 22:55:06,774 INFO [StoreOpener-f5ff2dc2c8d65f11f0ecb2681def8a43-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region f5ff2dc2c8d65f11f0ecb2681def8a43 2023-03-11 22:55:06,776 DEBUG [StoreOpener-f5ff2dc2c8d65f11f0ecb2681def8a43-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family1 2023-03-11 22:55:06,776 DEBUG [StoreOpener-f5ff2dc2c8d65f11f0ecb2681def8a43-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family1 2023-03-11 22:55:06,777 INFO [StoreOpener-f5ff2dc2c8d65f11f0ecb2681def8a43-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f5ff2dc2c8d65f11f0ecb2681def8a43 columnFamilyName family1 2023-03-11 22:55:06,798 DEBUG [StoreOpener-f5ff2dc2c8d65f11f0ecb2681def8a43-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family1/testCompactionWithHFileLink=f5ff2dc2c8d65f11f0ecb2681def8a43-6dcf1deb771d4f1684637d7e9f23839d 2023-03-11 22:55:06,803 DEBUG [StoreOpener-f5ff2dc2c8d65f11f0ecb2681def8a43-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family1/testCompactionWithHFileLink=f5ff2dc2c8d65f11f0ecb2681def8a43-7da2cf4d34844cb08bfda2f1981a5aa3 2023-03-11 22:55:06,810 DEBUG [StoreOpener-f5ff2dc2c8d65f11f0ecb2681def8a43-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family1/testCompactionWithHFileLink=f5ff2dc2c8d65f11f0ecb2681def8a43-a2c8cd3ba10746a5857f359843a355cb 2023-03-11 22:55:06,815 DEBUG [StoreOpener-f5ff2dc2c8d65f11f0ecb2681def8a43-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family1/testCompactionWithHFileLink=f5ff2dc2c8d65f11f0ecb2681def8a43-b71bc618951c43e69e774b42be4b0bef 2023-03-11 22:55:06,815 INFO [StoreOpener-f5ff2dc2c8d65f11f0ecb2681def8a43-1] regionserver.HStore(310): Store=f5ff2dc2c8d65f11f0ecb2681def8a43/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-11 22:55:06,816 INFO [StoreOpener-f5ff2dc2c8d65f11f0ecb2681def8a43-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region f5ff2dc2c8d65f11f0ecb2681def8a43 2023-03-11 22:55:06,817 DEBUG [StoreOpener-f5ff2dc2c8d65f11f0ecb2681def8a43-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family2 2023-03-11 22:55:06,817 DEBUG [StoreOpener-f5ff2dc2c8d65f11f0ecb2681def8a43-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family2 2023-03-11 22:55:06,817 INFO [StoreOpener-f5ff2dc2c8d65f11f0ecb2681def8a43-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f5ff2dc2c8d65f11f0ecb2681def8a43 columnFamilyName family2 2023-03-11 22:55:06,825 DEBUG [StoreOpener-f5ff2dc2c8d65f11f0ecb2681def8a43-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family2/testCompactionWithHFileLink=f5ff2dc2c8d65f11f0ecb2681def8a43-3968f87f78914e98a705a9c15c526df6 2023-03-11 22:55:06,830 DEBUG [StoreOpener-f5ff2dc2c8d65f11f0ecb2681def8a43-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family2/testCompactionWithHFileLink=f5ff2dc2c8d65f11f0ecb2681def8a43-56a3feebc66c4f1b84e6eae2fe9cef71 2023-03-11 22:55:06,836 DEBUG [StoreOpener-f5ff2dc2c8d65f11f0ecb2681def8a43-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family2/testCompactionWithHFileLink=f5ff2dc2c8d65f11f0ecb2681def8a43-79ebb06592894586af3575e3868c1041 2023-03-11 22:55:06,842 DEBUG [StoreOpener-f5ff2dc2c8d65f11f0ecb2681def8a43-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family2/testCompactionWithHFileLink=f5ff2dc2c8d65f11f0ecb2681def8a43-9811e2f543154038a3c389b2b7bae676 2023-03-11 22:55:06,842 INFO [StoreOpener-f5ff2dc2c8d65f11f0ecb2681def8a43-1] regionserver.HStore(310): Store=f5ff2dc2c8d65f11f0ecb2681def8a43/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-11 22:55:06,843 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43 2023-03-11 22:55:06,844 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43 2023-03-11 22:55:06,845 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-11 22:55:06,846 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for f5ff2dc2c8d65f11f0ecb2681def8a43 2023-03-11 22:55:06,847 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened f5ff2dc2c8d65f11f0ecb2681def8a43; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59587617, jitterRate=-0.1120753139257431}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-11 22:55:06,847 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for f5ff2dc2c8d65f11f0ecb2681def8a43: 2023-03-11 22:55:06,847 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,,1678575280100.f5ff2dc2c8d65f11f0ecb2681def8a43., pid=102, masterSystemTime=1678575306766 2023-03-11 22:55:06,847 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-11 22:55:06,848 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-03-11 22:55:06,848 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-03-11 22:55:06,848 DEBUG [RS:0;jenkins-hbase20:41843-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-03-11 22:55:06,850 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,,1678575280100.f5ff2dc2c8d65f11f0ecb2681def8a43. 2023-03-11 22:55:06,850 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,,1678575280100.f5ff2dc2c8d65f11f0ecb2681def8a43. 2023-03-11 22:55:06,850 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,1,1678575280100.c9557b829346f7133c6ea3c6c1b42236. 2023-03-11 22:55:06,850 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c9557b829346f7133c6ea3c6c1b42236, NAME => 'testCompactionWithHFileLink,1,1678575280100.c9557b829346f7133c6ea3c6c1b42236.', STARTKEY => '1', ENDKEY => '2'} 2023-03-11 22:55:06,850 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=f5ff2dc2c8d65f11f0ecb2681def8a43, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:06,850 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink c9557b829346f7133c6ea3c6c1b42236 2023-03-11 22:55:06,850 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,,1678575280100.f5ff2dc2c8d65f11f0ecb2681def8a43.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1678575306850"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1678575306850"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678575306850"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678575306850"}]},"ts":"1678575306850"} 2023-03-11 22:55:06,850 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1678575280100.c9557b829346f7133c6ea3c6c1b42236.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-11 22:55:06,850 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for c9557b829346f7133c6ea3c6c1b42236 2023-03-11 22:55:06,851 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for c9557b829346f7133c6ea3c6c1b42236 2023-03-11 22:55:06,851 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 22152 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-03-11 22:55:06,851 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] regionserver.HStore(1912): f5ff2dc2c8d65f11f0ecb2681def8a43/family1 is initiating minor compaction (all files) 2023-03-11 22:55:06,851 DEBUG [RS:0;jenkins-hbase20:41843-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-03-11 22:55:06,852 DEBUG [RS:0;jenkins-hbase20:41843-longCompactions-0] regionserver.HStore(1912): f5ff2dc2c8d65f11f0ecb2681def8a43/family2 is initiating minor compaction (all files) 2023-03-11 22:55:06,852 INFO [RS:0;jenkins-hbase20:41843-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of f5ff2dc2c8d65f11f0ecb2681def8a43/family1 in testCompactionWithHFileLink,,1678575280100.f5ff2dc2c8d65f11f0ecb2681def8a43. 2023-03-11 22:55:06,852 INFO [RS:0;jenkins-hbase20:41843-longCompactions-0] regionserver.HRegion(2259): Starting compaction of f5ff2dc2c8d65f11f0ecb2681def8a43/family2 in testCompactionWithHFileLink,,1678575280100.f5ff2dc2c8d65f11f0ecb2681def8a43. 2023-03-11 22:55:06,852 INFO [StoreOpener-c9557b829346f7133c6ea3c6c1b42236-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region c9557b829346f7133c6ea3c6c1b42236 2023-03-11 22:55:06,852 INFO [RS:0;jenkins-hbase20:41843-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family1/testCompactionWithHFileLink=f5ff2dc2c8d65f11f0ecb2681def8a43-b71bc618951c43e69e774b42be4b0bef, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family1/testCompactionWithHFileLink=f5ff2dc2c8d65f11f0ecb2681def8a43-6dcf1deb771d4f1684637d7e9f23839d, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family1/testCompactionWithHFileLink=f5ff2dc2c8d65f11f0ecb2681def8a43-a2c8cd3ba10746a5857f359843a355cb, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family1/testCompactionWithHFileLink=f5ff2dc2c8d65f11f0ecb2681def8a43-7da2cf4d34844cb08bfda2f1981a5aa3] into tmpdir=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/.tmp, totalSize=21.6 K 2023-03-11 22:55:06,852 INFO [RS:0;jenkins-hbase20:41843-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family2/testCompactionWithHFileLink=f5ff2dc2c8d65f11f0ecb2681def8a43-56a3feebc66c4f1b84e6eae2fe9cef71, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family2/testCompactionWithHFileLink=f5ff2dc2c8d65f11f0ecb2681def8a43-9811e2f543154038a3c389b2b7bae676, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family2/testCompactionWithHFileLink=f5ff2dc2c8d65f11f0ecb2681def8a43-79ebb06592894586af3575e3868c1041, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family2/testCompactionWithHFileLink=f5ff2dc2c8d65f11f0ecb2681def8a43-3968f87f78914e98a705a9c15c526df6] into tmpdir=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/.tmp, totalSize=20.4 K 2023-03-11 22:55:06,853 DEBUG [StoreOpener-c9557b829346f7133c6ea3c6c1b42236-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family1 2023-03-11 22:55:06,853 DEBUG [StoreOpener-c9557b829346f7133c6ea3c6c1b42236-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family1 2023-03-11 22:55:06,853 DEBUG [RS:0;jenkins-hbase20:41843-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=f5ff2dc2c8d65f11f0ecb2681def8a43-56a3feebc66c4f1b84e6eae2fe9cef71, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678575282225 2023-03-11 22:55:06,853 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=f5ff2dc2c8d65f11f0ecb2681def8a43-b71bc618951c43e69e774b42be4b0bef, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678575282225 2023-03-11 22:55:06,853 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=98 2023-03-11 22:55:06,853 INFO [StoreOpener-c9557b829346f7133c6ea3c6c1b42236-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c9557b829346f7133c6ea3c6c1b42236 columnFamilyName family1 2023-03-11 22:55:06,853 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=98, state=SUCCESS; OpenRegionProcedure f5ff2dc2c8d65f11f0ecb2681def8a43, server=jenkins-hbase20.apache.org,41843,1678575183185 in 237 msec 2023-03-11 22:55:06,854 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=f5ff2dc2c8d65f11f0ecb2681def8a43-6dcf1deb771d4f1684637d7e9f23839d, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678575284029 2023-03-11 22:55:06,854 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=98, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f5ff2dc2c8d65f11f0ecb2681def8a43, ASSIGN in 393 msec 2023-03-11 22:55:06,854 DEBUG [RS:0;jenkins-hbase20:41843-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=f5ff2dc2c8d65f11f0ecb2681def8a43-9811e2f543154038a3c389b2b7bae676, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678575284029 2023-03-11 22:55:06,855 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=f5ff2dc2c8d65f11f0ecb2681def8a43-a2c8cd3ba10746a5857f359843a355cb, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678575285863 2023-03-11 22:55:06,855 DEBUG [RS:0;jenkins-hbase20:41843-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=f5ff2dc2c8d65f11f0ecb2681def8a43-79ebb06592894586af3575e3868c1041, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678575285863 2023-03-11 22:55:06,855 DEBUG [RS:0;jenkins-hbase20:41843-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=f5ff2dc2c8d65f11f0ecb2681def8a43-3968f87f78914e98a705a9c15c526df6, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678575287297 2023-03-11 22:55:06,857 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=f5ff2dc2c8d65f11f0ecb2681def8a43-7da2cf4d34844cb08bfda2f1981a5aa3, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678575287297 2023-03-11 22:55:06,867 DEBUG [StoreOpener-c9557b829346f7133c6ea3c6c1b42236-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family1/testCompactionWithHFileLink=c9557b829346f7133c6ea3c6c1b42236-18bc795cc708409888f506cea46a1ceb 2023-03-11 22:55:06,874 DEBUG [StoreOpener-c9557b829346f7133c6ea3c6c1b42236-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family1/testCompactionWithHFileLink=c9557b829346f7133c6ea3c6c1b42236-501392378a5d499b90c1edfbc30e4277 2023-03-11 22:55:06,881 DEBUG [StoreOpener-c9557b829346f7133c6ea3c6c1b42236-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family1/testCompactionWithHFileLink=c9557b829346f7133c6ea3c6c1b42236-d4a76178692149918ee59f0c53bd768e 2023-03-11 22:55:06,882 INFO [RS:0;jenkins-hbase20:41843-longCompactions-0] throttle.PressureAwareThroughputController(145): f5ff2dc2c8d65f11f0ecb2681def8a43#family2#compaction#114 average throughput is 0.58 MB/second, slept 0 time(s) and total slept time is 0 ms. 1 active operations remaining, total limit is 50.00 MB/second 2023-03-11 22:55:06,884 INFO [RS:0;jenkins-hbase20:41843-shortCompactions-0] throttle.PressureAwareThroughputController(145): f5ff2dc2c8d65f11f0ecb2681def8a43#family1#compaction#115 average throughput is 0.78 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-11 22:55:06,895 DEBUG [StoreOpener-c9557b829346f7133c6ea3c6c1b42236-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family1/testCompactionWithHFileLink=c9557b829346f7133c6ea3c6c1b42236-de777f4aa41a4d8fb92468da0d003d99 2023-03-11 22:55:06,895 INFO [StoreOpener-c9557b829346f7133c6ea3c6c1b42236-1] regionserver.HStore(310): Store=c9557b829346f7133c6ea3c6c1b42236/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-11 22:55:06,895 INFO [StoreOpener-c9557b829346f7133c6ea3c6c1b42236-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region c9557b829346f7133c6ea3c6c1b42236 2023-03-11 22:55:06,896 DEBUG [StoreOpener-c9557b829346f7133c6ea3c6c1b42236-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family2 2023-03-11 22:55:06,896 DEBUG [StoreOpener-c9557b829346f7133c6ea3c6c1b42236-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family2 2023-03-11 22:55:06,896 INFO [StoreOpener-c9557b829346f7133c6ea3c6c1b42236-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c9557b829346f7133c6ea3c6c1b42236 columnFamilyName family2 2023-03-11 22:55:06,902 DEBUG [StoreOpener-c9557b829346f7133c6ea3c6c1b42236-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family2/testCompactionWithHFileLink=c9557b829346f7133c6ea3c6c1b42236-03ba98a6910540ec9e47b184aac49932 2023-03-11 22:55:06,908 DEBUG [StoreOpener-c9557b829346f7133c6ea3c6c1b42236-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family2/testCompactionWithHFileLink=c9557b829346f7133c6ea3c6c1b42236-08c74fbf215e40af9afa551a84198fdc 2023-03-11 22:55:06,915 DEBUG [StoreOpener-c9557b829346f7133c6ea3c6c1b42236-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family2/testCompactionWithHFileLink=c9557b829346f7133c6ea3c6c1b42236-f0aea611a01547acbf71afe50f36b56e 2023-03-11 22:55:06,922 DEBUG [StoreOpener-c9557b829346f7133c6ea3c6c1b42236-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family2/testCompactionWithHFileLink=c9557b829346f7133c6ea3c6c1b42236-f8c70657fdc84511b043d1760c4a13b4 2023-03-11 22:55:06,923 INFO [StoreOpener-c9557b829346f7133c6ea3c6c1b42236-1] regionserver.HStore(310): Store=c9557b829346f7133c6ea3c6c1b42236/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-11 22:55:06,924 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236 2023-03-11 22:55:06,925 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236 2023-03-11 22:55:06,926 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-11 22:55:06,927 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for c9557b829346f7133c6ea3c6c1b42236 2023-03-11 22:55:06,928 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened c9557b829346f7133c6ea3c6c1b42236; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65400081, jitterRate=-0.02546285092830658}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-11 22:55:06,928 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for c9557b829346f7133c6ea3c6c1b42236: 2023-03-11 22:55:06,929 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,1,1678575280100.c9557b829346f7133c6ea3c6c1b42236., pid=103, masterSystemTime=1678575306766 2023-03-11 22:55:06,929 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-03-11 22:55:06,929 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-03-11 22:55:06,930 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,1,1678575280100.c9557b829346f7133c6ea3c6c1b42236. 2023-03-11 22:55:06,930 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,1,1678575280100.c9557b829346f7133c6ea3c6c1b42236. 2023-03-11 22:55:06,930 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,2,1678575280100.7189059ae0acaaffd2a7e63414af38f7. 2023-03-11 22:55:06,931 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7189059ae0acaaffd2a7e63414af38f7, NAME => 'testCompactionWithHFileLink,2,1678575280100.7189059ae0acaaffd2a7e63414af38f7.', STARTKEY => '2', ENDKEY => ''} 2023-03-11 22:55:06,931 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=c9557b829346f7133c6ea3c6c1b42236, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:06,931 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,1,1678575280100.c9557b829346f7133c6ea3c6c1b42236.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1678575306930"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1678575306930"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678575306930"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678575306930"}]},"ts":"1678575306930"} 2023-03-11 22:55:06,931 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 7189059ae0acaaffd2a7e63414af38f7 2023-03-11 22:55:06,931 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1678575280100.7189059ae0acaaffd2a7e63414af38f7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-11 22:55:06,931 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 7189059ae0acaaffd2a7e63414af38f7 2023-03-11 22:55:06,931 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 7189059ae0acaaffd2a7e63414af38f7 2023-03-11 22:55:06,933 INFO [StoreOpener-7189059ae0acaaffd2a7e63414af38f7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 7189059ae0acaaffd2a7e63414af38f7 2023-03-11 22:55:06,934 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=99 2023-03-11 22:55:06,934 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=99, state=SUCCESS; OpenRegionProcedure c9557b829346f7133c6ea3c6c1b42236, server=jenkins-hbase20.apache.org,41843,1678575183185 in 316 msec 2023-03-11 22:55:06,934 DEBUG [StoreOpener-7189059ae0acaaffd2a7e63414af38f7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family1 2023-03-11 22:55:06,934 DEBUG [StoreOpener-7189059ae0acaaffd2a7e63414af38f7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family1 2023-03-11 22:55:06,934 INFO [StoreOpener-7189059ae0acaaffd2a7e63414af38f7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7189059ae0acaaffd2a7e63414af38f7 columnFamilyName family1 2023-03-11 22:55:06,935 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=99, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=c9557b829346f7133c6ea3c6c1b42236, ASSIGN in 474 msec 2023-03-11 22:55:06,941 DEBUG [StoreOpener-7189059ae0acaaffd2a7e63414af38f7-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family1/testCompactionWithHFileLink=7189059ae0acaaffd2a7e63414af38f7-043642cf5ff64bcfbb11167818921f2a 2023-03-11 22:55:06,945 DEBUG [StoreOpener-7189059ae0acaaffd2a7e63414af38f7-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family1/testCompactionWithHFileLink=7189059ae0acaaffd2a7e63414af38f7-70a13ebdab6744bb8dd47dd67237f4ca 2023-03-11 22:55:06,951 DEBUG [StoreOpener-7189059ae0acaaffd2a7e63414af38f7-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family1/testCompactionWithHFileLink=7189059ae0acaaffd2a7e63414af38f7-792b51b4e7344f2bb05423e36d8dccac 2023-03-11 22:55:06,961 DEBUG [StoreOpener-7189059ae0acaaffd2a7e63414af38f7-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family1/testCompactionWithHFileLink=7189059ae0acaaffd2a7e63414af38f7-bd42d7e392e844e2a435e9965bbe4b52 2023-03-11 22:55:06,961 INFO [StoreOpener-7189059ae0acaaffd2a7e63414af38f7-1] regionserver.HStore(310): Store=7189059ae0acaaffd2a7e63414af38f7/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-11 22:55:06,962 INFO [StoreOpener-7189059ae0acaaffd2a7e63414af38f7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 7189059ae0acaaffd2a7e63414af38f7 2023-03-11 22:55:06,963 DEBUG [StoreOpener-7189059ae0acaaffd2a7e63414af38f7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family2 2023-03-11 22:55:06,963 DEBUG [StoreOpener-7189059ae0acaaffd2a7e63414af38f7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family2 2023-03-11 22:55:06,963 INFO [StoreOpener-7189059ae0acaaffd2a7e63414af38f7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7189059ae0acaaffd2a7e63414af38f7 columnFamilyName family2 2023-03-11 22:55:06,972 DEBUG [StoreOpener-7189059ae0acaaffd2a7e63414af38f7-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family2/testCompactionWithHFileLink=7189059ae0acaaffd2a7e63414af38f7-22a1925811b2401c869aa7abba4e22f2 2023-03-11 22:55:06,978 DEBUG [StoreOpener-7189059ae0acaaffd2a7e63414af38f7-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family2/testCompactionWithHFileLink=7189059ae0acaaffd2a7e63414af38f7-55033e843476407d82f5c58e2a278d03 2023-03-11 22:55:06,985 DEBUG [StoreOpener-7189059ae0acaaffd2a7e63414af38f7-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family2/testCompactionWithHFileLink=7189059ae0acaaffd2a7e63414af38f7-75664672bae7473c96efa0a98a865614 2023-03-11 22:55:06,990 DEBUG [StoreOpener-7189059ae0acaaffd2a7e63414af38f7-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family2/testCompactionWithHFileLink=7189059ae0acaaffd2a7e63414af38f7-85d83795bb82460c9e80c58c7c9ee030 2023-03-11 22:55:06,990 INFO [StoreOpener-7189059ae0acaaffd2a7e63414af38f7-1] regionserver.HStore(310): Store=7189059ae0acaaffd2a7e63414af38f7/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-11 22:55:06,991 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7 2023-03-11 22:55:06,992 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7 2023-03-11 22:55:06,993 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-11 22:55:06,994 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 7189059ae0acaaffd2a7e63414af38f7 2023-03-11 22:55:06,995 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 7189059ae0acaaffd2a7e63414af38f7; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62349095, jitterRate=-0.07092608511447906}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-11 22:55:06,995 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 7189059ae0acaaffd2a7e63414af38f7: 2023-03-11 22:55:06,996 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,2,1678575280100.7189059ae0acaaffd2a7e63414af38f7., pid=101, masterSystemTime=1678575306766 2023-03-11 22:55:06,996 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-03-11 22:55:06,996 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-03-11 22:55:06,997 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,2,1678575280100.7189059ae0acaaffd2a7e63414af38f7. 2023-03-11 22:55:06,997 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,2,1678575280100.7189059ae0acaaffd2a7e63414af38f7. 2023-03-11 22:55:06,997 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=7189059ae0acaaffd2a7e63414af38f7, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:06,997 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,2,1678575280100.7189059ae0acaaffd2a7e63414af38f7.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1678575306997"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1678575306997"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678575306997"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678575306997"}]},"ts":"1678575306997"} 2023-03-11 22:55:06,999 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=101, resume processing ppid=100 2023-03-11 22:55:06,999 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=100, state=SUCCESS; OpenRegionProcedure 7189059ae0acaaffd2a7e63414af38f7, server=jenkins-hbase20.apache.org,41843,1678575183185 in 383 msec 2023-03-11 22:55:07,000 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=100, resume processing ppid=97 2023-03-11 22:55:07,001 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=7189059ae0acaaffd2a7e63414af38f7, ASSIGN in 539 msec 2023-03-11 22:55:07,001 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678575307001"}]},"ts":"1678575307001"} 2023-03-11 22:55:07,002 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLED in hbase:meta 2023-03-11 22:55:07,003 INFO [PEWorker-5] procedure.EnableTableProcedure(310): Table 'testCompactionWithHFileLink' was successfully enabled. 2023-03-11 22:55:07,004 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; EnableTableProcedure table=testCompactionWithHFileLink in 555 msec 2023-03-11 22:55:07,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-03-11 22:55:07,061 INFO [Listener at localhost.localdomain/41563] client.HBaseAdmin$TableFuture(3541): Operation: ENABLE, Table Name: default:testCompactionWithHFileLink, procId: 97 completed 2023-03-11 22:55:07,079 DEBUG [Listener at localhost.localdomain/41563] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-11 22:55:07,090 DEBUG [Listener at localhost.localdomain/41563] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-11 22:55:07,096 DEBUG [Listener at localhost.localdomain/41563] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-11 22:55:07,097 DEBUG [Listener at localhost.localdomain/41563] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-11 22:55:07,102 INFO [Listener at localhost.localdomain/41563] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-03-11 22:55:07,117 INFO [Listener at localhost.localdomain/41563] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 12 selected files, and 0 irrelevant files table 'testCompactionWithHFileLink' and column 'family1' 2023-03-11 22:55:07,118 INFO [Listener at localhost.localdomain/41563] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testCompactionWithHFileLink' column='family1' 2023-03-11 22:55:07,118 DEBUG [Listener at localhost.localdomain/41563] zookeeper.ReadOnlyZKClient(139): Connect 0x56bb74b2 to 127.0.0.1:51815 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-11 22:55:07,122 DEBUG [Listener at localhost.localdomain/41563] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7025662b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-11 22:55:07,122 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230311 for table='testCompactionWithHFileLink' and column='family1' 2023-03-11 22:55:07,122 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230311 for table='testCompactionWithHFileLink' and column='family1' 2023-03-11 22:55:07,122 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230311 for table='testCompactionWithHFileLink' and column='family1' 2023-03-11 22:55:07,592 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230311722157f790814635ad65db8798fc418a to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230311722157f790814635ad65db8798fc418a 2023-03-11 22:55:07,592 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230311e4a841df3a974bd08e679b63210c479c to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230311e4a841df3a974bd08e679b63210c479c 2023-03-11 22:55:07,593 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230311 table='testCompactionWithHFileLink' column='family1' 2023-03-11 22:55:07,593 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230311 table='testCompactionWithHFileLink' column='family1' 2023-03-11 22:55:07,607 DEBUG [MobFileCompactionChore-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-11 22:55:07,611 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:55096, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-11 22:55:07,617 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-11 22:55:07,620 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:60902, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-11 22:55:07,638 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230311/family1/4ebbec1e929e42b2a75815d0ae0b817a first=Optional[2\x00\x00\x00\x00] last=Optional[2\x00\x00\x00\x07] 2023-03-11 22:55:07,638 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230311/family1/8775e1aeada94e6b9ff2c5844f557fa0 first=Optional[0\x00\x00\x00\x00] last=Optional[0\x00\x00\x00\x07] 2023-03-11 22:55:07,639 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,,1678575280100.f5ff2dc2c8d65f11f0ecb2681def8a43., hostname=jenkins-hbase20.apache.org,41843,1678575183185, seqNum=32 for row with hfile group [{family1,hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230311/family1/8775e1aeada94e6b9ff2c5844f557fa0}] 2023-03-11 22:55:07,639 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,2,1678575280100.7189059ae0acaaffd2a7e63414af38f7., hostname=jenkins-hbase20.apache.org,41843,1678575183185, seqNum=32 for row 2 with hfile group [{family1,hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230311/family1/4ebbec1e929e42b2a75815d0ae0b817a}] 2023-03-11 22:55:07,646 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230311/family1/8775e1aeada94e6b9ff2c5844f557fa0 for inclusion in f5ff2dc2c8d65f11f0ecb2681def8a43/family1 2023-03-11 22:55:07,646 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230311/family1/4ebbec1e929e42b2a75815d0ae0b817a for inclusion in 7189059ae0acaaffd2a7e63414af38f7/family1 2023-03-11 22:55:07,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x00 last=2\x00\x00\x00\x07 2023-03-11 22:55:07,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x00 last=0\x00\x00\x00\x07 2023-03-11 22:55:07,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.HStore(777): Region bounds: first=2 last= 2023-03-11 22:55:07,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(777): Region bounds: first= last=1 2023-03-11 22:55:07,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HRegion(2446): Flush status journal for f5ff2dc2c8d65f11f0ecb2681def8a43: 2023-03-11 22:55:07,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.HRegion(2446): Flush status journal for 7189059ae0acaaffd2a7e63414af38f7: 2023-03-11 22:55:07,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230311/family1/4ebbec1e929e42b2a75815d0ae0b817a to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testCompactionWithHFileLink__5dmojn16nhia4suiq95smv0t3v1ck44lv35469t88ebpe2804ovvt5aodkg75s7t/family1/4ebbec1e929e42b2a75815d0ae0b817a 2023-03-11 22:55:07,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230311/family1/8775e1aeada94e6b9ff2c5844f557fa0 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testCompactionWithHFileLink__ihkusm6g0je704q0i72qp7ghuf5utgjkaplbjg31g6333gh9tpm4cic44k6e05de/family1/8775e1aeada94e6b9ff2c5844f557fa0 2023-03-11 22:55:07,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testCompactionWithHFileLink__5dmojn16nhia4suiq95smv0t3v1ck44lv35469t88ebpe2804ovvt5aodkg75s7t/family1/4ebbec1e929e42b2a75815d0ae0b817a as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family1/1aa6e624a8474effa2c59910d7b0a07c_SeqId_34_ 2023-03-11 22:55:07,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testCompactionWithHFileLink__ihkusm6g0je704q0i72qp7ghuf5utgjkaplbjg31g6333gh9tpm4cic44k6e05de/family1/8775e1aeada94e6b9ff2c5844f557fa0 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family1/94a3d9103c454b70b07646b3b7567002_SeqId_34_ 2023-03-11 22:55:07,652 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testCompactionWithHFileLink__5dmojn16nhia4suiq95smv0t3v1ck44lv35469t88ebpe2804ovvt5aodkg75s7t/family1/4ebbec1e929e42b2a75815d0ae0b817a into 7189059ae0acaaffd2a7e63414af38f7/family1 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family1/1aa6e624a8474effa2c59910d7b0a07c_SeqId_34_ - updating store file list. 2023-03-11 22:55:07,652 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testCompactionWithHFileLink__ihkusm6g0je704q0i72qp7ghuf5utgjkaplbjg31g6333gh9tpm4cic44k6e05de/family1/8775e1aeada94e6b9ff2c5844f557fa0 into f5ff2dc2c8d65f11f0ecb2681def8a43/family1 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family1/94a3d9103c454b70b07646b3b7567002_SeqId_34_ - updating store file list. 2023-03-11 22:55:07,654 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family1/94a3d9103c454b70b07646b3b7567002_SeqId_34_ into f5ff2dc2c8d65f11f0ecb2681def8a43/family1 2023-03-11 22:55:07,654 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family1/1aa6e624a8474effa2c59910d7b0a07c_SeqId_34_ into 7189059ae0acaaffd2a7e63414af38f7/family1 2023-03-11 22:55:07,654 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testCompactionWithHFileLink__ihkusm6g0je704q0i72qp7ghuf5utgjkaplbjg31g6333gh9tpm4cic44k6e05de/family1/8775e1aeada94e6b9ff2c5844f557fa0 into f5ff2dc2c8d65f11f0ecb2681def8a43/family1 (new location: hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family1/94a3d9103c454b70b07646b3b7567002_SeqId_34_) 2023-03-11 22:55:07,654 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testCompactionWithHFileLink__5dmojn16nhia4suiq95smv0t3v1ck44lv35469t88ebpe2804ovvt5aodkg75s7t/family1/4ebbec1e929e42b2a75815d0ae0b817a into 7189059ae0acaaffd2a7e63414af38f7/family1 (new location: hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family1/1aa6e624a8474effa2c59910d7b0a07c_SeqId_34_) 2023-03-11 22:55:07,655 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testCompactionWithHFileLink__5dmojn16nhia4suiq95smv0t3v1ck44lv35469t88ebpe2804ovvt5aodkg75s7t/family1/4ebbec1e929e42b2a75815d0ae0b817a 2023-03-11 22:55:07,655 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testCompactionWithHFileLink__ihkusm6g0je704q0i72qp7ghuf5utgjkaplbjg31g6333gh9tpm4cic44k6e05de/family1/8775e1aeada94e6b9ff2c5844f557fa0 2023-03-11 22:55:07,655 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-11 22:55:07,656 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230311 table='testCompactionWithHFileLink' column='family1' 2023-03-11 22:55:07,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 5 files of size 29606 starting at candidate #0 after considering 6 permutations with 6 in ratio 2023-03-11 22:55:07,657 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 22:55:07,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.HStore(1912): 7189059ae0acaaffd2a7e63414af38f7/family1 is initiating minor compaction (all files) 2023-03-11 22:55:07,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@428b99ec; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=5), splitQueue=0 2023-03-11 22:55:07,658 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202303113fc32ad601054ce383d790ba61e9b1d9 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202303113fc32ad601054ce383d790ba61e9b1d9 2023-03-11 22:55:07,659 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230311 table='testCompactionWithHFileLink' column='family1' 2023-03-11 22:55:07,659 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202303119f211bc34e194a71bf189bd5baf45037 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202303119f211bc34e194a71bf189bd5baf45037 2023-03-11 22:55:07,659 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 22:55:07,660 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230311eadcedaacb5d4629984edc323cb2ca58 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230311eadcedaacb5d4629984edc323cb2ca58 2023-03-11 22:55:07,661 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202303112d52c5edbd894361b1998c4735e4a082 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202303112d52c5edbd894361b1998c4735e4a082 2023-03-11 22:55:07,661 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230311f3e1642b0eae497e8943343bd9127843 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230311f3e1642b0eae497e8943343bd9127843 2023-03-11 22:55:07,661 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-03-11 22:55:07,661 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230311' 2023-03-11 22:55:07,661 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230311 for table='testCompactionWithHFileLink' and column='family1' 2023-03-11 22:55:07,661 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202303117cac817e46b249e58838f77e044220eb to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202303117cac817e46b249e58838f77e044220eb 2023-03-11 22:55:07,662 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202303119e2f565be17f40a48d173fb84aee091c to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202303119e2f565be17f40a48d173fb84aee091c 2023-03-11 22:55:07,663 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230311e5edfb7e86044da99c8e8fc0b0d075d5 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230311e5edfb7e86044da99c8e8fc0b0d075d5 2023-03-11 22:55:07,663 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-03-11 22:55:07,663 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230311' 2023-03-11 22:55:07,664 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230311 for table='testCompactionWithHFileLink' and column='family1' 2023-03-11 22:55:07,996 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202303112b4c4a1e112e4564a64f2ff896a51823 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202303112b4c4a1e112e4564a64f2ff896a51823 2023-03-11 22:55:07,998 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230311 table='testCompactionWithHFileLink' column='family1' 2023-03-11 22:55:08,023 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230311/family1/2da92ca5acf246ee91c5be4eac8a4448 first=Optional[1\x00\x00\x00\x00] last=Optional[1\x00\x00\x00\x07] 2023-03-11 22:55:08,024 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,1,1678575280100.c9557b829346f7133c6ea3c6c1b42236., hostname=jenkins-hbase20.apache.org,41843,1678575183185, seqNum=32 for row 1 with hfile group [{family1,hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230311/family1/2da92ca5acf246ee91c5be4eac8a4448}] 2023-03-11 22:55:08,026 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230311/family1/2da92ca5acf246ee91c5be4eac8a4448 for inclusion in c9557b829346f7133c6ea3c6c1b42236/family1 2023-03-11 22:55:08,029 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x00 last=1\x00\x00\x00\x07 2023-03-11 22:55:08,029 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.HStore(777): Region bounds: first=1 last=2 2023-03-11 22:55:08,030 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.HRegion(2446): Flush status journal for c9557b829346f7133c6ea3c6c1b42236: 2023-03-11 22:55:08,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230311/family1/2da92ca5acf246ee91c5be4eac8a4448 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testCompactionWithHFileLink__d9koonl7i3ii467tep63fhc71ncfkdjfreda09a4g1c6bja4fc786cojh1g971ta/family1/2da92ca5acf246ee91c5be4eac8a4448 2023-03-11 22:55:08,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testCompactionWithHFileLink__d9koonl7i3ii467tep63fhc71ncfkdjfreda09a4g1c6bja4fc786cojh1g971ta/family1/2da92ca5acf246ee91c5be4eac8a4448 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family1/964b74c7ace940b486dfe87a686d55b3_SeqId_34_ 2023-03-11 22:55:08,033 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testCompactionWithHFileLink__d9koonl7i3ii467tep63fhc71ncfkdjfreda09a4g1c6bja4fc786cojh1g971ta/family1/2da92ca5acf246ee91c5be4eac8a4448 into c9557b829346f7133c6ea3c6c1b42236/family1 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family1/964b74c7ace940b486dfe87a686d55b3_SeqId_34_ - updating store file list. 2023-03-11 22:55:08,036 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family1/964b74c7ace940b486dfe87a686d55b3_SeqId_34_ into c9557b829346f7133c6ea3c6c1b42236/family1 2023-03-11 22:55:08,036 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testCompactionWithHFileLink__d9koonl7i3ii467tep63fhc71ncfkdjfreda09a4g1c6bja4fc786cojh1g971ta/family1/2da92ca5acf246ee91c5be4eac8a4448 into c9557b829346f7133c6ea3c6c1b42236/family1 (new location: hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family1/964b74c7ace940b486dfe87a686d55b3_SeqId_34_) 2023-03-11 22:55:08,036 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testCompactionWithHFileLink__d9koonl7i3ii467tep63fhc71ncfkdjfreda09a4g1c6bja4fc786cojh1g971ta/family1/2da92ca5acf246ee91c5be4eac8a4448 2023-03-11 22:55:08,036 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-11 22:55:08,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 5 files of size 29606 starting at candidate #0 after considering 6 permutations with 6 in ratio 2023-03-11 22:55:08,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.HStore(1912): c9557b829346f7133c6ea3c6c1b42236/family1 is initiating minor compaction (all files) 2023-03-11 22:55:08,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@47719a08; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=6), splitQueue=0 2023-03-11 22:55:08,040 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230311 table='testCompactionWithHFileLink' column='family1' 2023-03-11 22:55:08,041 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 22:55:08,042 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202303118527fef18c5e485c949f1cd3a30c3aaa to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202303118527fef18c5e485c949f1cd3a30c3aaa 2023-03-11 22:55:08,043 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230311a27e4a83b27c4b30b2875268932f5f96 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230311a27e4a83b27c4b30b2875268932f5f96 2023-03-11 22:55:08,043 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230311d39059d225114219bb95e51a3bf73129 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230311d39059d225114219bb95e51a3bf73129 2023-03-11 22:55:08,044 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230311ecd72b1e22a74ca4941b5e1642c89708 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230311ecd72b1e22a74ca4941b5e1642c89708 2023-03-11 22:55:08,044 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-03-11 22:55:08,044 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230311' 2023-03-11 22:55:08,044 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230311 for table='testCompactionWithHFileLink' and column='family1' 2023-03-11 22:55:08,044 INFO [Listener at localhost.localdomain/41563] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testCompactionWithHFileLink' column='family1' 2023-03-11 22:55:08,047 DEBUG [Listener at localhost.localdomain/41563] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-11 22:55:08,049 DEBUG [Listener at localhost.localdomain/41563] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-11 22:55:08,053 DEBUG [Listener at localhost.localdomain/41563] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-11 22:55:08,054 DEBUG [Listener at localhost.localdomain/41563] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-11 22:55:08,060 DEBUG [Listener at localhost.localdomain/41563] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-11 22:55:08,061 DEBUG [Listener at localhost.localdomain/41563] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-11 22:55:08,076 INFO [Listener at localhost.localdomain/41563] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testCompactionWithHFileLink Thread=284 (was 244) - Thread LEAK? -, OpenFileDescriptor=762 (was 608) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=162 (was 216), ProcessCount=168 (was 168), AvailableMemoryMB=21442 (was 21555) 2023-03-11 22:55:08,086 INFO [Listener at localhost.localdomain/41563] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompaction Thread=284, OpenFileDescriptor=762, MaxFileDescriptor=60000, SystemLoadAverage=162, ProcessCount=168, AvailableMemoryMB=21441 2023-03-11 22:55:08,090 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.HMaster$15(3014): Client=jenkins//148.251.75.209 creating {NAME => 'ns'} 2023-03-11 22:55:08,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=ns 2023-03-11 22:55:08,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1227): Checking to see if procedure is done pid=104 2023-03-11 22:55:08,097 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-03-11 22:55:08,098 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; CreateNamespaceProcedure, namespace=ns in 7 msec 2023-03-11 22:55:08,107 DEBUG [RS:0;jenkins-hbase20:41843-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/.tmp/family2/a03976b13171497881379acc673cbaaa as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family2/a03976b13171497881379acc673cbaaa 2023-03-11 22:55:08,113 DEBUG [RS:0;jenkins-hbase20:41843-longCompactions-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testCompactionWithHFileLink' 2023-03-11 22:55:08,113 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/.tmp/family1/9ef31462ca544af48c17c75a06e533cf as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family1/9ef31462ca544af48c17c75a06e533cf 2023-03-11 22:55:08,114 INFO [RS:0;jenkins-hbase20:41843-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in f5ff2dc2c8d65f11f0ecb2681def8a43/family2 of f5ff2dc2c8d65f11f0ecb2681def8a43 into a03976b13171497881379acc673cbaaa(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-11 22:55:08,114 DEBUG [RS:0;jenkins-hbase20:41843-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for f5ff2dc2c8d65f11f0ecb2681def8a43: 2023-03-11 22:55:08,114 INFO [RS:0;jenkins-hbase20:41843-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,,1678575280100.f5ff2dc2c8d65f11f0ecb2681def8a43., storeName=f5ff2dc2c8d65f11f0ecb2681def8a43/family2, priority=12, startTime=1678575306848; duration=1sec 2023-03-11 22:55:08,114 DEBUG [RS:0;jenkins-hbase20:41843-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=6), splitQueue=0 2023-03-11 22:55:08,115 INFO [RS:0;jenkins-hbase20:41843-longCompactions-0] regionserver.HRegion(2259): Starting compaction of 7189059ae0acaaffd2a7e63414af38f7/family1 in testCompactionWithHFileLink,2,1678575280100.7189059ae0acaaffd2a7e63414af38f7. 2023-03-11 22:55:08,115 INFO [RS:0;jenkins-hbase20:41843-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family1/testCompactionWithHFileLink=7189059ae0acaaffd2a7e63414af38f7-bd42d7e392e844e2a435e9965bbe4b52, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family1/testCompactionWithHFileLink=7189059ae0acaaffd2a7e63414af38f7-792b51b4e7344f2bb05423e36d8dccac, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family1/testCompactionWithHFileLink=7189059ae0acaaffd2a7e63414af38f7-70a13ebdab6744bb8dd47dd67237f4ca, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family1/testCompactionWithHFileLink=7189059ae0acaaffd2a7e63414af38f7-043642cf5ff64bcfbb11167818921f2a, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family1/1aa6e624a8474effa2c59910d7b0a07c_SeqId_34_] into tmpdir=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/.tmp, totalSize=28.9 K 2023-03-11 22:55:08,116 DEBUG [RS:0;jenkins-hbase20:41843-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=7189059ae0acaaffd2a7e63414af38f7-bd42d7e392e844e2a435e9965bbe4b52, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678575282226 2023-03-11 22:55:08,117 DEBUG [RS:0;jenkins-hbase20:41843-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=7189059ae0acaaffd2a7e63414af38f7-792b51b4e7344f2bb05423e36d8dccac, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678575284031 2023-03-11 22:55:08,118 DEBUG [RS:0;jenkins-hbase20:41843-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=7189059ae0acaaffd2a7e63414af38f7-70a13ebdab6744bb8dd47dd67237f4ca, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678575285864 2023-03-11 22:55:08,118 DEBUG [RS:0;jenkins-hbase20:41843-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=7189059ae0acaaffd2a7e63414af38f7-043642cf5ff64bcfbb11167818921f2a, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678575287298 2023-03-11 22:55:08,119 DEBUG [RS:0;jenkins-hbase20:41843-longCompactions-0] compactions.Compactor(207): Compacting 1aa6e624a8474effa2c59910d7b0a07c_SeqId_34_, keycount=16, bloomtype=ROW, size=7.3 K, encoding=NONE, compression=NONE, seqNum=35, earliestPutTs=1678575282226 2023-03-11 22:55:08,120 INFO [RS:0;jenkins-hbase20:41843-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in f5ff2dc2c8d65f11f0ecb2681def8a43/family1 of f5ff2dc2c8d65f11f0ecb2681def8a43 into 9ef31462ca544af48c17c75a06e533cf(size=7.6 K), total size for store is 14.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-11 22:55:08,120 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for f5ff2dc2c8d65f11f0ecb2681def8a43: 2023-03-11 22:55:08,120 INFO [RS:0;jenkins-hbase20:41843-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,,1678575280100.f5ff2dc2c8d65f11f0ecb2681def8a43., storeName=f5ff2dc2c8d65f11f0ecb2681def8a43/family1, priority=12, startTime=1678575306847; duration=1sec 2023-03-11 22:55:08,120 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=5), splitQueue=0 2023-03-11 22:55:08,120 INFO [RS:0;jenkins-hbase20:41843-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of c9557b829346f7133c6ea3c6c1b42236/family1 in testCompactionWithHFileLink,1,1678575280100.c9557b829346f7133c6ea3c6c1b42236. 2023-03-11 22:55:08,121 INFO [RS:0;jenkins-hbase20:41843-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family1/testCompactionWithHFileLink=c9557b829346f7133c6ea3c6c1b42236-de777f4aa41a4d8fb92468da0d003d99, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family1/testCompactionWithHFileLink=c9557b829346f7133c6ea3c6c1b42236-501392378a5d499b90c1edfbc30e4277, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family1/testCompactionWithHFileLink=c9557b829346f7133c6ea3c6c1b42236-18bc795cc708409888f506cea46a1ceb, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family1/testCompactionWithHFileLink=c9557b829346f7133c6ea3c6c1b42236-d4a76178692149918ee59f0c53bd768e, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family1/964b74c7ace940b486dfe87a686d55b3_SeqId_34_] into tmpdir=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/.tmp, totalSize=28.9 K 2023-03-11 22:55:08,121 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=c9557b829346f7133c6ea3c6c1b42236-de777f4aa41a4d8fb92468da0d003d99, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678575282226 2023-03-11 22:55:08,122 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=c9557b829346f7133c6ea3c6c1b42236-501392378a5d499b90c1edfbc30e4277, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678575284030 2023-03-11 22:55:08,123 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=c9557b829346f7133c6ea3c6c1b42236-18bc795cc708409888f506cea46a1ceb, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678575285863 2023-03-11 22:55:08,124 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=c9557b829346f7133c6ea3c6c1b42236-d4a76178692149918ee59f0c53bd768e, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678575287298 2023-03-11 22:55:08,125 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] compactions.Compactor(207): Compacting 964b74c7ace940b486dfe87a686d55b3_SeqId_34_, keycount=16, bloomtype=ROW, size=7.3 K, encoding=NONE, compression=NONE, seqNum=35, earliestPutTs=1678575282226 2023-03-11 22:55:08,139 INFO [RS:0;jenkins-hbase20:41843-longCompactions-0] throttle.PressureAwareThroughputController(145): 7189059ae0acaaffd2a7e63414af38f7#family1#compaction#116 average throughput is 0.58 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-11 22:55:08,142 INFO [RS:0;jenkins-hbase20:41843-shortCompactions-0] throttle.PressureAwareThroughputController(145): c9557b829346f7133c6ea3c6c1b42236#family1#compaction#117 average throughput is 1.17 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-11 22:55:08,164 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family1/testCompactionWithHFileLink=f5ff2dc2c8d65f11f0ecb2681def8a43-b71bc618951c43e69e774b42be4b0bef, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family1/testCompactionWithHFileLink=f5ff2dc2c8d65f11f0ecb2681def8a43-6dcf1deb771d4f1684637d7e9f23839d, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family1/testCompactionWithHFileLink=f5ff2dc2c8d65f11f0ecb2681def8a43-a2c8cd3ba10746a5857f359843a355cb, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family1/testCompactionWithHFileLink=f5ff2dc2c8d65f11f0ecb2681def8a43-7da2cf4d34844cb08bfda2f1981a5aa3] to archive 2023-03-11 22:55:08,165 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 22:55:08,167 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family1/testCompactionWithHFileLink=f5ff2dc2c8d65f11f0ecb2681def8a43-b71bc618951c43e69e774b42be4b0bef to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family1/testCompactionWithHFileLink=f5ff2dc2c8d65f11f0ecb2681def8a43-b71bc618951c43e69e774b42be4b0bef 2023-03-11 22:55:08,169 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family1/testCompactionWithHFileLink=f5ff2dc2c8d65f11f0ecb2681def8a43-6dcf1deb771d4f1684637d7e9f23839d to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family1/testCompactionWithHFileLink=f5ff2dc2c8d65f11f0ecb2681def8a43-6dcf1deb771d4f1684637d7e9f23839d 2023-03-11 22:55:08,170 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family1/testCompactionWithHFileLink=f5ff2dc2c8d65f11f0ecb2681def8a43-a2c8cd3ba10746a5857f359843a355cb to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family1/testCompactionWithHFileLink=f5ff2dc2c8d65f11f0ecb2681def8a43-a2c8cd3ba10746a5857f359843a355cb 2023-03-11 22:55:08,172 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family1/testCompactionWithHFileLink=f5ff2dc2c8d65f11f0ecb2681def8a43-7da2cf4d34844cb08bfda2f1981a5aa3 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family1/testCompactionWithHFileLink=f5ff2dc2c8d65f11f0ecb2681def8a43-7da2cf4d34844cb08bfda2f1981a5aa3 2023-03-11 22:55:08,174 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family2/testCompactionWithHFileLink=f5ff2dc2c8d65f11f0ecb2681def8a43-56a3feebc66c4f1b84e6eae2fe9cef71, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family2/testCompactionWithHFileLink=f5ff2dc2c8d65f11f0ecb2681def8a43-9811e2f543154038a3c389b2b7bae676, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family2/testCompactionWithHFileLink=f5ff2dc2c8d65f11f0ecb2681def8a43-79ebb06592894586af3575e3868c1041, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family2/testCompactionWithHFileLink=f5ff2dc2c8d65f11f0ecb2681def8a43-3968f87f78914e98a705a9c15c526df6] to archive 2023-03-11 22:55:08,174 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 22:55:08,176 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family2/testCompactionWithHFileLink=f5ff2dc2c8d65f11f0ecb2681def8a43-56a3feebc66c4f1b84e6eae2fe9cef71 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family2/testCompactionWithHFileLink=f5ff2dc2c8d65f11f0ecb2681def8a43-56a3feebc66c4f1b84e6eae2fe9cef71 2023-03-11 22:55:08,178 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family2/testCompactionWithHFileLink=f5ff2dc2c8d65f11f0ecb2681def8a43-9811e2f543154038a3c389b2b7bae676 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family2/testCompactionWithHFileLink=f5ff2dc2c8d65f11f0ecb2681def8a43-9811e2f543154038a3c389b2b7bae676 2023-03-11 22:55:08,179 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family2/testCompactionWithHFileLink=f5ff2dc2c8d65f11f0ecb2681def8a43-79ebb06592894586af3575e3868c1041 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family2/testCompactionWithHFileLink=f5ff2dc2c8d65f11f0ecb2681def8a43-79ebb06592894586af3575e3868c1041 2023-03-11 22:55:08,181 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family2/testCompactionWithHFileLink=f5ff2dc2c8d65f11f0ecb2681def8a43-3968f87f78914e98a705a9c15c526df6 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/family2/testCompactionWithHFileLink=f5ff2dc2c8d65f11f0ecb2681def8a43-3968f87f78914e98a705a9c15c526df6 2023-03-11 22:55:08,197 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1227): Checking to see if procedure is done pid=104 2023-03-11 22:55:08,200 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-03-11 22:55:08,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=ns:testMinorCompaction 2023-03-11 22:55:08,205 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_PRE_OPERATION 2023-03-11 22:55:08,205 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(697): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "ns" qualifier: "testMinorCompaction" procId is: 105 2023-03-11 22:55:08,206 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-11 22:55:08,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-03-11 22:55:08,210 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/.tmp/data/ns/testMinorCompaction/1d03ff70922c0981304d6eab43d86f2b 2023-03-11 22:55:08,210 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/.tmp/data/ns/testMinorCompaction/7087f753e6d78287d81e1391b6bb5914 2023-03-11 22:55:08,210 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/.tmp/data/ns/testMinorCompaction/84e7ece417189721cd2d8b7121fcfa8d 2023-03-11 22:55:08,211 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/.tmp/data/ns/testMinorCompaction/1d03ff70922c0981304d6eab43d86f2b empty. 2023-03-11 22:55:08,211 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/.tmp/data/ns/testMinorCompaction/7087f753e6d78287d81e1391b6bb5914 empty. 2023-03-11 22:55:08,211 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/.tmp/data/ns/testMinorCompaction/84e7ece417189721cd2d8b7121fcfa8d empty. 2023-03-11 22:55:08,211 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/.tmp/data/ns/testMinorCompaction/1d03ff70922c0981304d6eab43d86f2b 2023-03-11 22:55:08,211 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/.tmp/data/ns/testMinorCompaction/7087f753e6d78287d81e1391b6bb5914 2023-03-11 22:55:08,212 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/.tmp/data/ns/testMinorCompaction/84e7ece417189721cd2d8b7121fcfa8d 2023-03-11 22:55:08,212 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived ns:testMinorCompaction regions 2023-03-11 22:55:08,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-03-11 22:55:08,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-03-11 22:55:08,557 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/.tmp/family1/75c6aefd72ac4a56927f9a443de4b4ec as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family1/75c6aefd72ac4a56927f9a443de4b4ec 2023-03-11 22:55:08,561 INFO [RS:0;jenkins-hbase20:41843-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 5 (all) file(s) in c9557b829346f7133c6ea3c6c1b42236/family1 of c9557b829346f7133c6ea3c6c1b42236 into 75c6aefd72ac4a56927f9a443de4b4ec(size=7.6 K), total size for store is 7.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-11 22:55:08,561 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for c9557b829346f7133c6ea3c6c1b42236: 2023-03-11 22:55:08,561 INFO [RS:0;jenkins-hbase20:41843-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testCompactionWithHFileLink,1,1678575280100.c9557b829346f7133c6ea3c6c1b42236., storeName=family1, fileCount=5, fileSize=28.9 K (5.4 K, 5.4 K, 5.4 K, 5.4 K, 7.3 K), priority=2, time=1678575308038; duration=0sec 2023-03-11 22:55:08,561 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-03-11 22:55:08,561 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-03-11 22:55:08,563 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-03-11 22:55:08,563 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] regionserver.HStore(1912): c9557b829346f7133c6ea3c6c1b42236/family2 is initiating minor compaction (all files) 2023-03-11 22:55:08,563 INFO [RS:0;jenkins-hbase20:41843-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of c9557b829346f7133c6ea3c6c1b42236/family2 in testCompactionWithHFileLink,1,1678575280100.c9557b829346f7133c6ea3c6c1b42236. 2023-03-11 22:55:08,563 INFO [RS:0;jenkins-hbase20:41843-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family2/testCompactionWithHFileLink=c9557b829346f7133c6ea3c6c1b42236-f0aea611a01547acbf71afe50f36b56e, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family2/testCompactionWithHFileLink=c9557b829346f7133c6ea3c6c1b42236-08c74fbf215e40af9afa551a84198fdc, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family2/testCompactionWithHFileLink=c9557b829346f7133c6ea3c6c1b42236-f8c70657fdc84511b043d1760c4a13b4, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family2/testCompactionWithHFileLink=c9557b829346f7133c6ea3c6c1b42236-03ba98a6910540ec9e47b184aac49932] into tmpdir=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/.tmp, totalSize=20.4 K 2023-03-11 22:55:08,564 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=c9557b829346f7133c6ea3c6c1b42236-f0aea611a01547acbf71afe50f36b56e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678575282226 2023-03-11 22:55:08,564 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=c9557b829346f7133c6ea3c6c1b42236-08c74fbf215e40af9afa551a84198fdc, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678575284030 2023-03-11 22:55:08,565 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=c9557b829346f7133c6ea3c6c1b42236-f8c70657fdc84511b043d1760c4a13b4, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678575285863 2023-03-11 22:55:08,565 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=c9557b829346f7133c6ea3c6c1b42236-03ba98a6910540ec9e47b184aac49932, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678575287298 2023-03-11 22:55:08,574 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family1/testCompactionWithHFileLink=c9557b829346f7133c6ea3c6c1b42236-de777f4aa41a4d8fb92468da0d003d99, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family1/testCompactionWithHFileLink=c9557b829346f7133c6ea3c6c1b42236-501392378a5d499b90c1edfbc30e4277, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family1/testCompactionWithHFileLink=c9557b829346f7133c6ea3c6c1b42236-18bc795cc708409888f506cea46a1ceb, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family1/testCompactionWithHFileLink=c9557b829346f7133c6ea3c6c1b42236-d4a76178692149918ee59f0c53bd768e, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family1/964b74c7ace940b486dfe87a686d55b3_SeqId_34_] to archive 2023-03-11 22:55:08,575 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 22:55:08,577 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family1/testCompactionWithHFileLink=c9557b829346f7133c6ea3c6c1b42236-de777f4aa41a4d8fb92468da0d003d99 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family1/testCompactionWithHFileLink=c9557b829346f7133c6ea3c6c1b42236-de777f4aa41a4d8fb92468da0d003d99 2023-03-11 22:55:08,578 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family1/testCompactionWithHFileLink=c9557b829346f7133c6ea3c6c1b42236-501392378a5d499b90c1edfbc30e4277 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family1/testCompactionWithHFileLink=c9557b829346f7133c6ea3c6c1b42236-501392378a5d499b90c1edfbc30e4277 2023-03-11 22:55:08,580 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family1/testCompactionWithHFileLink=c9557b829346f7133c6ea3c6c1b42236-18bc795cc708409888f506cea46a1ceb to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family1/testCompactionWithHFileLink=c9557b829346f7133c6ea3c6c1b42236-18bc795cc708409888f506cea46a1ceb 2023-03-11 22:55:08,581 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family1/testCompactionWithHFileLink=c9557b829346f7133c6ea3c6c1b42236-d4a76178692149918ee59f0c53bd768e to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family1/testCompactionWithHFileLink=c9557b829346f7133c6ea3c6c1b42236-d4a76178692149918ee59f0c53bd768e 2023-03-11 22:55:08,581 INFO [RS:0;jenkins-hbase20:41843-shortCompactions-0] throttle.PressureAwareThroughputController(145): c9557b829346f7133c6ea3c6c1b42236#family2#compaction#118 average throughput is 0.58 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-11 22:55:08,582 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family1/964b74c7ace940b486dfe87a686d55b3_SeqId_34_ to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family1/964b74c7ace940b486dfe87a686d55b3_SeqId_34_ 2023-03-11 22:55:08,619 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/.tmp/data/ns/testMinorCompaction/.tabledesc/.tableinfo.0000000001 2023-03-11 22:55:08,621 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(7675): creating {ENCODED => 1d03ff70922c0981304d6eab43d86f2b, NAME => 'ns:testMinorCompaction,,1678575308200.1d03ff70922c0981304d6eab43d86f2b.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/.tmp 2023-03-11 22:55:08,621 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(7675): creating {ENCODED => 84e7ece417189721cd2d8b7121fcfa8d, NAME => 'ns:testMinorCompaction,2,1678575308200.84e7ece417189721cd2d8b7121fcfa8d.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/.tmp 2023-03-11 22:55:08,621 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(7675): creating {ENCODED => 7087f753e6d78287d81e1391b6bb5914, NAME => 'ns:testMinorCompaction,1,1678575308200.7087f753e6d78287d81e1391b6bb5914.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/.tmp 2023-03-11 22:55:08,629 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,,1678575308200.1d03ff70922c0981304d6eab43d86f2b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-11 22:55:08,629 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1604): Closing 1d03ff70922c0981304d6eab43d86f2b, disabling compactions & flushes 2023-03-11 22:55:08,629 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,,1678575308200.1d03ff70922c0981304d6eab43d86f2b. 2023-03-11 22:55:08,629 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,,1678575308200.1d03ff70922c0981304d6eab43d86f2b. 2023-03-11 22:55:08,629 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,,1678575308200.1d03ff70922c0981304d6eab43d86f2b. after waiting 0 ms 2023-03-11 22:55:08,629 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,,1678575308200.1d03ff70922c0981304d6eab43d86f2b. 2023-03-11 22:55:08,629 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,,1678575308200.1d03ff70922c0981304d6eab43d86f2b. 2023-03-11 22:55:08,629 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1558): Region close journal for 1d03ff70922c0981304d6eab43d86f2b: 2023-03-11 22:55:08,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-03-11 22:55:08,959 DEBUG [RS:0;jenkins-hbase20:41843-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/.tmp/family1/3746dafe3dc54aa399daee360c0e9946 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family1/3746dafe3dc54aa399daee360c0e9946 2023-03-11 22:55:08,964 INFO [RS:0;jenkins-hbase20:41843-longCompactions-0] regionserver.HStore(1652): Completed compaction of 5 (all) file(s) in 7189059ae0acaaffd2a7e63414af38f7/family1 of 7189059ae0acaaffd2a7e63414af38f7 into 3746dafe3dc54aa399daee360c0e9946(size=7.6 K), total size for store is 7.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-11 22:55:08,964 DEBUG [RS:0;jenkins-hbase20:41843-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for 7189059ae0acaaffd2a7e63414af38f7: 2023-03-11 22:55:08,964 INFO [RS:0;jenkins-hbase20:41843-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testCompactionWithHFileLink,2,1678575280100.7189059ae0acaaffd2a7e63414af38f7., storeName=family1, fileCount=5, fileSize=28.9 K (5.4 K, 5.4 K, 5.4 K, 5.4 K, 7.3 K), priority=2, time=1678575307657; duration=0sec 2023-03-11 22:55:08,965 DEBUG [RS:0;jenkins-hbase20:41843-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-03-11 22:55:08,965 DEBUG [RS:0;jenkins-hbase20:41843-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-03-11 22:55:08,967 DEBUG [RS:0;jenkins-hbase20:41843-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-03-11 22:55:08,968 DEBUG [RS:0;jenkins-hbase20:41843-longCompactions-0] regionserver.HStore(1912): 7189059ae0acaaffd2a7e63414af38f7/family2 is initiating minor compaction (all files) 2023-03-11 22:55:08,968 INFO [RS:0;jenkins-hbase20:41843-longCompactions-0] regionserver.HRegion(2259): Starting compaction of 7189059ae0acaaffd2a7e63414af38f7/family2 in testCompactionWithHFileLink,2,1678575280100.7189059ae0acaaffd2a7e63414af38f7. 2023-03-11 22:55:08,968 INFO [RS:0;jenkins-hbase20:41843-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family2/testCompactionWithHFileLink=7189059ae0acaaffd2a7e63414af38f7-85d83795bb82460c9e80c58c7c9ee030, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family2/testCompactionWithHFileLink=7189059ae0acaaffd2a7e63414af38f7-22a1925811b2401c869aa7abba4e22f2, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family2/testCompactionWithHFileLink=7189059ae0acaaffd2a7e63414af38f7-55033e843476407d82f5c58e2a278d03, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family2/testCompactionWithHFileLink=7189059ae0acaaffd2a7e63414af38f7-75664672bae7473c96efa0a98a865614] into tmpdir=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/.tmp, totalSize=20.4 K 2023-03-11 22:55:08,968 DEBUG [RS:0;jenkins-hbase20:41843-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=7189059ae0acaaffd2a7e63414af38f7-85d83795bb82460c9e80c58c7c9ee030, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678575282226 2023-03-11 22:55:08,969 DEBUG [RS:0;jenkins-hbase20:41843-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=7189059ae0acaaffd2a7e63414af38f7-22a1925811b2401c869aa7abba4e22f2, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678575284031 2023-03-11 22:55:08,970 DEBUG [RS:0;jenkins-hbase20:41843-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=7189059ae0acaaffd2a7e63414af38f7-55033e843476407d82f5c58e2a278d03, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678575285864 2023-03-11 22:55:08,971 DEBUG [RS:0;jenkins-hbase20:41843-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=7189059ae0acaaffd2a7e63414af38f7-75664672bae7473c96efa0a98a865614, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678575287298 2023-03-11 22:55:08,991 INFO [RS:0;jenkins-hbase20:41843-longCompactions-0] throttle.PressureAwareThroughputController(145): 7189059ae0acaaffd2a7e63414af38f7#family2#compaction#119 average throughput is 0.29 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-11 22:55:09,029 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,2,1678575308200.84e7ece417189721cd2d8b7121fcfa8d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-11 22:55:09,029 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1604): Closing 84e7ece417189721cd2d8b7121fcfa8d, disabling compactions & flushes 2023-03-11 22:55:09,029 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,1,1678575308200.7087f753e6d78287d81e1391b6bb5914.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-11 22:55:09,029 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,2,1678575308200.84e7ece417189721cd2d8b7121fcfa8d. 2023-03-11 22:55:09,029 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,2,1678575308200.84e7ece417189721cd2d8b7121fcfa8d. 2023-03-11 22:55:09,030 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,2,1678575308200.84e7ece417189721cd2d8b7121fcfa8d. after waiting 0 ms 2023-03-11 22:55:09,029 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1604): Closing 7087f753e6d78287d81e1391b6bb5914, disabling compactions & flushes 2023-03-11 22:55:09,030 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,1,1678575308200.7087f753e6d78287d81e1391b6bb5914. 2023-03-11 22:55:09,030 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,1,1678575308200.7087f753e6d78287d81e1391b6bb5914. 2023-03-11 22:55:09,030 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,1,1678575308200.7087f753e6d78287d81e1391b6bb5914. after waiting 0 ms 2023-03-11 22:55:09,030 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,2,1678575308200.84e7ece417189721cd2d8b7121fcfa8d. 2023-03-11 22:55:09,030 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1838): Closed ns:testMinorCompaction,2,1678575308200.84e7ece417189721cd2d8b7121fcfa8d. 2023-03-11 22:55:09,030 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,1,1678575308200.7087f753e6d78287d81e1391b6bb5914. 2023-03-11 22:55:09,030 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1558): Region close journal for 84e7ece417189721cd2d8b7121fcfa8d: 2023-03-11 22:55:09,030 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1838): Closed ns:testMinorCompaction,1,1678575308200.7087f753e6d78287d81e1391b6bb5914. 2023-03-11 22:55:09,030 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1558): Region close journal for 7087f753e6d78287d81e1391b6bb5914: 2023-03-11 22:55:09,033 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_ADD_TO_META 2023-03-11 22:55:09,034 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,,1678575308200.1d03ff70922c0981304d6eab43d86f2b.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1678575309034"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678575309034"}]},"ts":"1678575309034"} 2023-03-11 22:55:09,034 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,2,1678575308200.84e7ece417189721cd2d8b7121fcfa8d.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1678575309034"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678575309034"}]},"ts":"1678575309034"} 2023-03-11 22:55:09,034 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,1,1678575308200.7087f753e6d78287d81e1391b6bb5914.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1678575309034"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678575309034"}]},"ts":"1678575309034"} 2023-03-11 22:55:09,036 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-03-11 22:55:09,037 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-11 22:55:09,038 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"ns:testMinorCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678575309037"}]},"ts":"1678575309037"} 2023-03-11 22:55:09,039 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=ns:testMinorCompaction, state=ENABLING in hbase:meta 2023-03-11 22:55:09,042 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-11 22:55:09,042 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=1d03ff70922c0981304d6eab43d86f2b, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=7087f753e6d78287d81e1391b6bb5914, ASSIGN}, {pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=84e7ece417189721cd2d8b7121fcfa8d, ASSIGN}] 2023-03-11 22:55:09,044 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=84e7ece417189721cd2d8b7121fcfa8d, ASSIGN 2023-03-11 22:55:09,044 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=7087f753e6d78287d81e1391b6bb5914, ASSIGN 2023-03-11 22:55:09,045 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=1d03ff70922c0981304d6eab43d86f2b, ASSIGN 2023-03-11 22:55:09,045 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=84e7ece417189721cd2d8b7121fcfa8d, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,41843,1678575183185; forceNewPlan=false, retain=false 2023-03-11 22:55:09,045 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=7087f753e6d78287d81e1391b6bb5914, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,41843,1678575183185; forceNewPlan=false, retain=false 2023-03-11 22:55:09,045 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=1d03ff70922c0981304d6eab43d86f2b, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,41843,1678575183185; forceNewPlan=false, retain=false 2023-03-11 22:55:09,070 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family1/testCompactionWithHFileLink=7189059ae0acaaffd2a7e63414af38f7-bd42d7e392e844e2a435e9965bbe4b52, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family1/testCompactionWithHFileLink=7189059ae0acaaffd2a7e63414af38f7-792b51b4e7344f2bb05423e36d8dccac, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family1/testCompactionWithHFileLink=7189059ae0acaaffd2a7e63414af38f7-70a13ebdab6744bb8dd47dd67237f4ca, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family1/testCompactionWithHFileLink=7189059ae0acaaffd2a7e63414af38f7-043642cf5ff64bcfbb11167818921f2a, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family1/1aa6e624a8474effa2c59910d7b0a07c_SeqId_34_] to archive 2023-03-11 22:55:09,071 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 22:55:09,073 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family1/testCompactionWithHFileLink=7189059ae0acaaffd2a7e63414af38f7-bd42d7e392e844e2a435e9965bbe4b52 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family1/testCompactionWithHFileLink=7189059ae0acaaffd2a7e63414af38f7-bd42d7e392e844e2a435e9965bbe4b52 2023-03-11 22:55:09,074 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family1/testCompactionWithHFileLink=7189059ae0acaaffd2a7e63414af38f7-792b51b4e7344f2bb05423e36d8dccac to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family1/testCompactionWithHFileLink=7189059ae0acaaffd2a7e63414af38f7-792b51b4e7344f2bb05423e36d8dccac 2023-03-11 22:55:09,075 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family1/testCompactionWithHFileLink=7189059ae0acaaffd2a7e63414af38f7-70a13ebdab6744bb8dd47dd67237f4ca to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family1/testCompactionWithHFileLink=7189059ae0acaaffd2a7e63414af38f7-70a13ebdab6744bb8dd47dd67237f4ca 2023-03-11 22:55:09,076 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family1/testCompactionWithHFileLink=7189059ae0acaaffd2a7e63414af38f7-043642cf5ff64bcfbb11167818921f2a to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family1/testCompactionWithHFileLink=7189059ae0acaaffd2a7e63414af38f7-043642cf5ff64bcfbb11167818921f2a 2023-03-11 22:55:09,077 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family1/1aa6e624a8474effa2c59910d7b0a07c_SeqId_34_ to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family1/1aa6e624a8474effa2c59910d7b0a07c_SeqId_34_ 2023-03-11 22:55:09,199 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=1d03ff70922c0981304d6eab43d86f2b, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:09,199 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=7087f753e6d78287d81e1391b6bb5914, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:09,199 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=108 updating hbase:meta row=84e7ece417189721cd2d8b7121fcfa8d, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:09,200 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,,1678575308200.1d03ff70922c0981304d6eab43d86f2b.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1678575309199"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1678575309199"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678575309199"}]},"ts":"1678575309199"} 2023-03-11 22:55:09,200 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,2,1678575308200.84e7ece417189721cd2d8b7121fcfa8d.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1678575309199"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1678575309199"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678575309199"}]},"ts":"1678575309199"} 2023-03-11 22:55:09,200 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,1,1678575308200.7087f753e6d78287d81e1391b6bb5914.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1678575309199"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1678575309199"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678575309199"}]},"ts":"1678575309199"} 2023-03-11 22:55:09,202 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=106, state=RUNNABLE; OpenRegionProcedure 1d03ff70922c0981304d6eab43d86f2b, server=jenkins-hbase20.apache.org,41843,1678575183185}] 2023-03-11 22:55:09,203 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=110, ppid=108, state=RUNNABLE; OpenRegionProcedure 84e7ece417189721cd2d8b7121fcfa8d, server=jenkins-hbase20.apache.org,41843,1678575183185}] 2023-03-11 22:55:09,203 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=111, ppid=107, state=RUNNABLE; OpenRegionProcedure 7087f753e6d78287d81e1391b6bb5914, server=jenkins-hbase20.apache.org,41843,1678575183185}] 2023-03-11 22:55:09,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-03-11 22:55:09,360 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open ns:testMinorCompaction,,1678575308200.1d03ff70922c0981304d6eab43d86f2b. 2023-03-11 22:55:09,360 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1d03ff70922c0981304d6eab43d86f2b, NAME => 'ns:testMinorCompaction,,1678575308200.1d03ff70922c0981304d6eab43d86f2b.', STARTKEY => '', ENDKEY => '1'} 2023-03-11 22:55:09,361 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction 1d03ff70922c0981304d6eab43d86f2b 2023-03-11 22:55:09,361 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,,1678575308200.1d03ff70922c0981304d6eab43d86f2b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-11 22:55:09,361 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 1d03ff70922c0981304d6eab43d86f2b 2023-03-11 22:55:09,361 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 1d03ff70922c0981304d6eab43d86f2b 2023-03-11 22:55:09,364 INFO [StoreOpener-1d03ff70922c0981304d6eab43d86f2b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 1d03ff70922c0981304d6eab43d86f2b 2023-03-11 22:55:09,366 DEBUG [StoreOpener-1d03ff70922c0981304d6eab43d86f2b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/1d03ff70922c0981304d6eab43d86f2b/family1 2023-03-11 22:55:09,366 DEBUG [StoreOpener-1d03ff70922c0981304d6eab43d86f2b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/1d03ff70922c0981304d6eab43d86f2b/family1 2023-03-11 22:55:09,367 INFO [StoreOpener-1d03ff70922c0981304d6eab43d86f2b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1d03ff70922c0981304d6eab43d86f2b columnFamilyName family1 2023-03-11 22:55:09,368 INFO [StoreOpener-1d03ff70922c0981304d6eab43d86f2b-1] regionserver.HStore(310): Store=1d03ff70922c0981304d6eab43d86f2b/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-11 22:55:09,368 INFO [StoreOpener-1d03ff70922c0981304d6eab43d86f2b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 1d03ff70922c0981304d6eab43d86f2b 2023-03-11 22:55:09,370 DEBUG [StoreOpener-1d03ff70922c0981304d6eab43d86f2b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/1d03ff70922c0981304d6eab43d86f2b/family2 2023-03-11 22:55:09,370 DEBUG [StoreOpener-1d03ff70922c0981304d6eab43d86f2b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/1d03ff70922c0981304d6eab43d86f2b/family2 2023-03-11 22:55:09,370 INFO [StoreOpener-1d03ff70922c0981304d6eab43d86f2b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1d03ff70922c0981304d6eab43d86f2b columnFamilyName family2 2023-03-11 22:55:09,372 INFO [StoreOpener-1d03ff70922c0981304d6eab43d86f2b-1] regionserver.HStore(310): Store=1d03ff70922c0981304d6eab43d86f2b/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-11 22:55:09,372 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/1d03ff70922c0981304d6eab43d86f2b 2023-03-11 22:55:09,373 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/1d03ff70922c0981304d6eab43d86f2b 2023-03-11 22:55:09,375 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-11 22:55:09,376 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 1d03ff70922c0981304d6eab43d86f2b 2023-03-11 22:55:09,379 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/1d03ff70922c0981304d6eab43d86f2b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-11 22:55:09,379 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 1d03ff70922c0981304d6eab43d86f2b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61603054, jitterRate=-0.08204296231269836}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-11 22:55:09,379 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 1d03ff70922c0981304d6eab43d86f2b: 2023-03-11 22:55:09,380 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for ns:testMinorCompaction,,1678575308200.1d03ff70922c0981304d6eab43d86f2b., pid=109, masterSystemTime=1678575309354 2023-03-11 22:55:09,382 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for ns:testMinorCompaction,,1678575308200.1d03ff70922c0981304d6eab43d86f2b. 2023-03-11 22:55:09,382 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened ns:testMinorCompaction,,1678575308200.1d03ff70922c0981304d6eab43d86f2b. 2023-03-11 22:55:09,382 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open ns:testMinorCompaction,1,1678575308200.7087f753e6d78287d81e1391b6bb5914. 2023-03-11 22:55:09,382 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7087f753e6d78287d81e1391b6bb5914, NAME => 'ns:testMinorCompaction,1,1678575308200.7087f753e6d78287d81e1391b6bb5914.', STARTKEY => '1', ENDKEY => '2'} 2023-03-11 22:55:09,382 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=1d03ff70922c0981304d6eab43d86f2b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:09,382 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction 7087f753e6d78287d81e1391b6bb5914 2023-03-11 22:55:09,382 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,,1678575308200.1d03ff70922c0981304d6eab43d86f2b.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1678575309382"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1678575309382"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678575309382"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678575309382"}]},"ts":"1678575309382"} 2023-03-11 22:55:09,382 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,1,1678575308200.7087f753e6d78287d81e1391b6bb5914.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-11 22:55:09,383 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 7087f753e6d78287d81e1391b6bb5914 2023-03-11 22:55:09,383 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 7087f753e6d78287d81e1391b6bb5914 2023-03-11 22:55:09,384 INFO [StoreOpener-7087f753e6d78287d81e1391b6bb5914-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 7087f753e6d78287d81e1391b6bb5914 2023-03-11 22:55:09,386 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=106 2023-03-11 22:55:09,386 DEBUG [StoreOpener-7087f753e6d78287d81e1391b6bb5914-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/7087f753e6d78287d81e1391b6bb5914/family1 2023-03-11 22:55:09,386 DEBUG [StoreOpener-7087f753e6d78287d81e1391b6bb5914-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/7087f753e6d78287d81e1391b6bb5914/family1 2023-03-11 22:55:09,386 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=106, state=SUCCESS; OpenRegionProcedure 1d03ff70922c0981304d6eab43d86f2b, server=jenkins-hbase20.apache.org,41843,1678575183185 in 182 msec 2023-03-11 22:55:09,387 INFO [StoreOpener-7087f753e6d78287d81e1391b6bb5914-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7087f753e6d78287d81e1391b6bb5914 columnFamilyName family1 2023-03-11 22:55:09,388 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=1d03ff70922c0981304d6eab43d86f2b, ASSIGN in 344 msec 2023-03-11 22:55:09,388 INFO [StoreOpener-7087f753e6d78287d81e1391b6bb5914-1] regionserver.HStore(310): Store=7087f753e6d78287d81e1391b6bb5914/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-11 22:55:09,388 INFO [StoreOpener-7087f753e6d78287d81e1391b6bb5914-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 7087f753e6d78287d81e1391b6bb5914 2023-03-11 22:55:09,390 DEBUG [StoreOpener-7087f753e6d78287d81e1391b6bb5914-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/7087f753e6d78287d81e1391b6bb5914/family2 2023-03-11 22:55:09,390 DEBUG [StoreOpener-7087f753e6d78287d81e1391b6bb5914-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/7087f753e6d78287d81e1391b6bb5914/family2 2023-03-11 22:55:09,390 INFO [StoreOpener-7087f753e6d78287d81e1391b6bb5914-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7087f753e6d78287d81e1391b6bb5914 columnFamilyName family2 2023-03-11 22:55:09,391 INFO [StoreOpener-7087f753e6d78287d81e1391b6bb5914-1] regionserver.HStore(310): Store=7087f753e6d78287d81e1391b6bb5914/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-11 22:55:09,392 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/7087f753e6d78287d81e1391b6bb5914 2023-03-11 22:55:09,392 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/7087f753e6d78287d81e1391b6bb5914 2023-03-11 22:55:09,394 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-11 22:55:09,395 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 7087f753e6d78287d81e1391b6bb5914 2023-03-11 22:55:09,397 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/7087f753e6d78287d81e1391b6bb5914/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-11 22:55:09,398 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 7087f753e6d78287d81e1391b6bb5914; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73024334, jitterRate=0.08814737200737}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-11 22:55:09,398 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 7087f753e6d78287d81e1391b6bb5914: 2023-03-11 22:55:09,399 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for ns:testMinorCompaction,1,1678575308200.7087f753e6d78287d81e1391b6bb5914., pid=111, masterSystemTime=1678575309354 2023-03-11 22:55:09,400 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for ns:testMinorCompaction,1,1678575308200.7087f753e6d78287d81e1391b6bb5914. 2023-03-11 22:55:09,400 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=7087f753e6d78287d81e1391b6bb5914, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:09,400 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened ns:testMinorCompaction,1,1678575308200.7087f753e6d78287d81e1391b6bb5914. 2023-03-11 22:55:09,400 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open ns:testMinorCompaction,2,1678575308200.84e7ece417189721cd2d8b7121fcfa8d. 2023-03-11 22:55:09,400 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,1,1678575308200.7087f753e6d78287d81e1391b6bb5914.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1678575309400"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1678575309400"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678575309400"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678575309400"}]},"ts":"1678575309400"} 2023-03-11 22:55:09,400 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 84e7ece417189721cd2d8b7121fcfa8d, NAME => 'ns:testMinorCompaction,2,1678575308200.84e7ece417189721cd2d8b7121fcfa8d.', STARTKEY => '2', ENDKEY => ''} 2023-03-11 22:55:09,401 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction 84e7ece417189721cd2d8b7121fcfa8d 2023-03-11 22:55:09,401 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,2,1678575308200.84e7ece417189721cd2d8b7121fcfa8d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-11 22:55:09,401 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 84e7ece417189721cd2d8b7121fcfa8d 2023-03-11 22:55:09,401 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 84e7ece417189721cd2d8b7121fcfa8d 2023-03-11 22:55:09,402 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/.tmp/family2/05571c06e30c47e08984d7648c2a0175 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family2/05571c06e30c47e08984d7648c2a0175 2023-03-11 22:55:09,402 INFO [StoreOpener-84e7ece417189721cd2d8b7121fcfa8d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 84e7ece417189721cd2d8b7121fcfa8d 2023-03-11 22:55:09,403 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=111, resume processing ppid=107 2023-03-11 22:55:09,403 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=111, ppid=107, state=SUCCESS; OpenRegionProcedure 7087f753e6d78287d81e1391b6bb5914, server=jenkins-hbase20.apache.org,41843,1678575183185 in 198 msec 2023-03-11 22:55:09,403 DEBUG [StoreOpener-84e7ece417189721cd2d8b7121fcfa8d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/84e7ece417189721cd2d8b7121fcfa8d/family1 2023-03-11 22:55:09,403 DEBUG [StoreOpener-84e7ece417189721cd2d8b7121fcfa8d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/84e7ece417189721cd2d8b7121fcfa8d/family1 2023-03-11 22:55:09,403 INFO [StoreOpener-84e7ece417189721cd2d8b7121fcfa8d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 84e7ece417189721cd2d8b7121fcfa8d columnFamilyName family1 2023-03-11 22:55:09,403 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=7087f753e6d78287d81e1391b6bb5914, ASSIGN in 361 msec 2023-03-11 22:55:09,404 INFO [StoreOpener-84e7ece417189721cd2d8b7121fcfa8d-1] regionserver.HStore(310): Store=84e7ece417189721cd2d8b7121fcfa8d/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-11 22:55:09,404 INFO [StoreOpener-84e7ece417189721cd2d8b7121fcfa8d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 84e7ece417189721cd2d8b7121fcfa8d 2023-03-11 22:55:09,405 DEBUG [StoreOpener-84e7ece417189721cd2d8b7121fcfa8d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/84e7ece417189721cd2d8b7121fcfa8d/family2 2023-03-11 22:55:09,405 DEBUG [StoreOpener-84e7ece417189721cd2d8b7121fcfa8d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/84e7ece417189721cd2d8b7121fcfa8d/family2 2023-03-11 22:55:09,405 INFO [StoreOpener-84e7ece417189721cd2d8b7121fcfa8d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 84e7ece417189721cd2d8b7121fcfa8d columnFamilyName family2 2023-03-11 22:55:09,405 INFO [RS:0;jenkins-hbase20:41843-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in c9557b829346f7133c6ea3c6c1b42236/family2 of c9557b829346f7133c6ea3c6c1b42236 into 05571c06e30c47e08984d7648c2a0175(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-11 22:55:09,405 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for c9557b829346f7133c6ea3c6c1b42236: 2023-03-11 22:55:09,405 INFO [RS:0;jenkins-hbase20:41843-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,1,1678575280100.c9557b829346f7133c6ea3c6c1b42236., storeName=c9557b829346f7133c6ea3c6c1b42236/family2, priority=12, startTime=1678575306929; duration=0sec 2023-03-11 22:55:09,406 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-03-11 22:55:09,406 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 1 store files, 0 compacting, 1 eligible, 16 blocking 2023-03-11 22:55:09,406 INFO [StoreOpener-84e7ece417189721cd2d8b7121fcfa8d-1] regionserver.HStore(310): Store=84e7ece417189721cd2d8b7121fcfa8d/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-11 22:55:09,406 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-03-11 22:55:09,406 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-03-11 22:55:09,406 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] regionserver.CompactSplit(415): Not compacting testCompactionWithHFileLink,2,1678575280100.7189059ae0acaaffd2a7e63414af38f7. because compaction request was cancelled 2023-03-11 22:55:09,406 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 1 store files, 0 compacting, 1 eligible, 16 blocking 2023-03-11 22:55:09,406 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-03-11 22:55:09,406 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-03-11 22:55:09,406 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] regionserver.CompactSplit(415): Not compacting testCompactionWithHFileLink,1,1678575280100.c9557b829346f7133c6ea3c6c1b42236. because compaction request was cancelled 2023-03-11 22:55:09,406 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/84e7ece417189721cd2d8b7121fcfa8d 2023-03-11 22:55:09,407 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/84e7ece417189721cd2d8b7121fcfa8d 2023-03-11 22:55:09,408 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-11 22:55:09,408 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 84e7ece417189721cd2d8b7121fcfa8d 2023-03-11 22:55:09,409 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/84e7ece417189721cd2d8b7121fcfa8d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-11 22:55:09,410 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 84e7ece417189721cd2d8b7121fcfa8d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67404357, jitterRate=0.0044031888246536255}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-11 22:55:09,410 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 84e7ece417189721cd2d8b7121fcfa8d: 2023-03-11 22:55:09,410 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for ns:testMinorCompaction,2,1678575308200.84e7ece417189721cd2d8b7121fcfa8d., pid=110, masterSystemTime=1678575309354 2023-03-11 22:55:09,411 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for ns:testMinorCompaction,2,1678575308200.84e7ece417189721cd2d8b7121fcfa8d. 2023-03-11 22:55:09,412 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened ns:testMinorCompaction,2,1678575308200.84e7ece417189721cd2d8b7121fcfa8d. 2023-03-11 22:55:09,412 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=108 updating hbase:meta row=84e7ece417189721cd2d8b7121fcfa8d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:09,412 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,2,1678575308200.84e7ece417189721cd2d8b7121fcfa8d.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1678575309412"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1678575309412"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678575309412"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678575309412"}]},"ts":"1678575309412"} 2023-03-11 22:55:09,414 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=110, resume processing ppid=108 2023-03-11 22:55:09,414 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=110, ppid=108, state=SUCCESS; OpenRegionProcedure 84e7ece417189721cd2d8b7121fcfa8d, server=jenkins-hbase20.apache.org,41843,1678575183185 in 211 msec 2023-03-11 22:55:09,416 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=105 2023-03-11 22:55:09,416 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=84e7ece417189721cd2d8b7121fcfa8d, ASSIGN in 372 msec 2023-03-11 22:55:09,416 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-11 22:55:09,416 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"ns:testMinorCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678575309416"}]},"ts":"1678575309416"} 2023-03-11 22:55:09,417 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=ns:testMinorCompaction, state=ENABLED in hbase:meta 2023-03-11 22:55:09,419 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_POST_OPERATION 2023-03-11 22:55:09,420 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=ns:testMinorCompaction in 1.2180 sec 2023-03-11 22:55:09,466 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family2/testCompactionWithHFileLink=c9557b829346f7133c6ea3c6c1b42236-f0aea611a01547acbf71afe50f36b56e, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family2/testCompactionWithHFileLink=c9557b829346f7133c6ea3c6c1b42236-08c74fbf215e40af9afa551a84198fdc, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family2/testCompactionWithHFileLink=c9557b829346f7133c6ea3c6c1b42236-f8c70657fdc84511b043d1760c4a13b4, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family2/testCompactionWithHFileLink=c9557b829346f7133c6ea3c6c1b42236-03ba98a6910540ec9e47b184aac49932] to archive 2023-03-11 22:55:09,467 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 22:55:09,471 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family2/testCompactionWithHFileLink=c9557b829346f7133c6ea3c6c1b42236-f0aea611a01547acbf71afe50f36b56e to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family2/testCompactionWithHFileLink=c9557b829346f7133c6ea3c6c1b42236-f0aea611a01547acbf71afe50f36b56e 2023-03-11 22:55:09,474 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family2/testCompactionWithHFileLink=c9557b829346f7133c6ea3c6c1b42236-08c74fbf215e40af9afa551a84198fdc to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family2/testCompactionWithHFileLink=c9557b829346f7133c6ea3c6c1b42236-08c74fbf215e40af9afa551a84198fdc 2023-03-11 22:55:09,477 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family2/testCompactionWithHFileLink=c9557b829346f7133c6ea3c6c1b42236-f8c70657fdc84511b043d1760c4a13b4 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family2/testCompactionWithHFileLink=c9557b829346f7133c6ea3c6c1b42236-f8c70657fdc84511b043d1760c4a13b4 2023-03-11 22:55:09,479 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family2/testCompactionWithHFileLink=c9557b829346f7133c6ea3c6c1b42236-03ba98a6910540ec9e47b184aac49932 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/family2/testCompactionWithHFileLink=c9557b829346f7133c6ea3c6c1b42236-03ba98a6910540ec9e47b184aac49932 2023-03-11 22:55:10,223 DEBUG [RS:0;jenkins-hbase20:41843-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/.tmp/family2/8590f4dbbd004fed80c2ef4aed2b1033 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family2/8590f4dbbd004fed80c2ef4aed2b1033 2023-03-11 22:55:10,230 INFO [RS:0;jenkins-hbase20:41843-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 7189059ae0acaaffd2a7e63414af38f7/family2 of 7189059ae0acaaffd2a7e63414af38f7 into 8590f4dbbd004fed80c2ef4aed2b1033(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-11 22:55:10,231 DEBUG [RS:0;jenkins-hbase20:41843-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for 7189059ae0acaaffd2a7e63414af38f7: 2023-03-11 22:55:10,231 INFO [RS:0;jenkins-hbase20:41843-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,2,1678575280100.7189059ae0acaaffd2a7e63414af38f7., storeName=7189059ae0acaaffd2a7e63414af38f7/family2, priority=12, startTime=1678575306996; duration=1sec 2023-03-11 22:55:10,231 DEBUG [RS:0;jenkins-hbase20:41843-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-11 22:55:10,267 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family2/testCompactionWithHFileLink=7189059ae0acaaffd2a7e63414af38f7-85d83795bb82460c9e80c58c7c9ee030, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family2/testCompactionWithHFileLink=7189059ae0acaaffd2a7e63414af38f7-22a1925811b2401c869aa7abba4e22f2, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family2/testCompactionWithHFileLink=7189059ae0acaaffd2a7e63414af38f7-55033e843476407d82f5c58e2a278d03, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family2/testCompactionWithHFileLink=7189059ae0acaaffd2a7e63414af38f7-75664672bae7473c96efa0a98a865614] to archive 2023-03-11 22:55:10,268 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 22:55:10,272 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family2/testCompactionWithHFileLink=7189059ae0acaaffd2a7e63414af38f7-85d83795bb82460c9e80c58c7c9ee030 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family2/testCompactionWithHFileLink=7189059ae0acaaffd2a7e63414af38f7-85d83795bb82460c9e80c58c7c9ee030 2023-03-11 22:55:10,274 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family2/testCompactionWithHFileLink=7189059ae0acaaffd2a7e63414af38f7-22a1925811b2401c869aa7abba4e22f2 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family2/testCompactionWithHFileLink=7189059ae0acaaffd2a7e63414af38f7-22a1925811b2401c869aa7abba4e22f2 2023-03-11 22:55:10,276 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family2/testCompactionWithHFileLink=7189059ae0acaaffd2a7e63414af38f7-55033e843476407d82f5c58e2a278d03 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family2/testCompactionWithHFileLink=7189059ae0acaaffd2a7e63414af38f7-55033e843476407d82f5c58e2a278d03 2023-03-11 22:55:10,278 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family2/testCompactionWithHFileLink=7189059ae0acaaffd2a7e63414af38f7-75664672bae7473c96efa0a98a865614 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/family2/testCompactionWithHFileLink=7189059ae0acaaffd2a7e63414af38f7-75664672bae7473c96efa0a98a865614 2023-03-11 22:55:10,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-03-11 22:55:10,315 INFO [Listener at localhost.localdomain/41563] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: ns:testMinorCompaction, procId: 105 completed 2023-03-11 22:55:10,325 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1678575308200.1d03ff70922c0981304d6eab43d86f2b. with WAL disabled. Data may be lost in the event of a crash. 2023-03-11 22:55:10,326 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1678575308200.7087f753e6d78287d81e1391b6bb5914. with WAL disabled. Data may be lost in the event of a crash. 2023-03-11 22:55:10,327 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1678575308200.84e7ece417189721cd2d8b7121fcfa8d. with WAL disabled. Data may be lost in the event of a crash. 2023-03-11 22:55:10,330 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-11 22:55:10,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-03-11 22:55:10,333 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-03-11 22:55:10,333 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:55:10,333 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-03-11 22:55:10,333 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-03-11 22:55:10,334 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-11 22:55:10,334 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-11 22:55:10,335 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:55:10,335 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:10,335 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:55:10,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:55:10,335 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:10,335 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 22:55:10,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-11 22:55:10,335 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-11 22:55:10,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 22:55:10,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-11 22:55:10,336 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-03-11 22:55:10,336 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-03-11 22:55:10,336 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-03-11 22:55:10,336 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:55:10,336 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-03-11 22:55:10,336 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1678575308200.7087f753e6d78287d81e1391b6bb5914. 2023-03-11 22:55:10,337 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1678575308200.1d03ff70922c0981304d6eab43d86f2b. 2023-03-11 22:55:10,337 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1678575308200.1d03ff70922c0981304d6eab43d86f2b. started... 2023-03-11 22:55:10,337 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1678575308200.84e7ece417189721cd2d8b7121fcfa8d. 2023-03-11 22:55:10,337 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1678575308200.84e7ece417189721cd2d8b7121fcfa8d. started... 2023-03-11 22:55:10,338 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 1d03ff70922c0981304d6eab43d86f2b 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-03-11 22:55:10,338 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 84e7ece417189721cd2d8b7121fcfa8d 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-03-11 22:55:10,337 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-11 22:55:10,338 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 22:55:10,337 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1678575308200.7087f753e6d78287d81e1391b6bb5914. started... 2023-03-11 22:55:10,339 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 7087f753e6d78287d81e1391b6bb5914 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-03-11 22:55:10,553 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'ns:testMinorCompaction' 2023-03-11 22:55:10,755 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230311fe5619cbb3d04a25aa0ec9ac02f94a9e to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20230311fe5619cbb3d04a25aa0ec9ac02f94a9e 2023-03-11 22:55:10,755 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230311bf4d6facf925452e87a6512ba0628771 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230311bf4d6facf925452e87a6512ba0628771 2023-03-11 22:55:10,755 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303119570252d28dc4192aecbe41eb337fbcf to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202303119570252d28dc4192aecbe41eb337fbcf 2023-03-11 22:55:11,161 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/7087f753e6d78287d81e1391b6bb5914/.tmp/family1/efeab45737fd42878d7dd3070ea2b1ce 2023-03-11 22:55:11,161 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/1d03ff70922c0981304d6eab43d86f2b/.tmp/family1/edce420e22de4221ba94f161a4402cfc 2023-03-11 22:55:11,167 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/84e7ece417189721cd2d8b7121fcfa8d/.tmp/family1/c6d2a3c7524d4e14a414c4b5cb972b2d 2023-03-11 22:55:11,239 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230311c1926f7664a14ba3aa47c72783db950d to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20230311c1926f7664a14ba3aa47c72783db950d 2023-03-11 22:55:11,265 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/84e7ece417189721cd2d8b7121fcfa8d/.tmp/family2/6e74c04fce9d49a299cf4aed735f59e2 2023-03-11 22:55:11,273 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/84e7ece417189721cd2d8b7121fcfa8d/.tmp/family1/c6d2a3c7524d4e14a414c4b5cb972b2d as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/84e7ece417189721cd2d8b7121fcfa8d/family1/c6d2a3c7524d4e14a414c4b5cb972b2d 2023-03-11 22:55:11,282 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/84e7ece417189721cd2d8b7121fcfa8d/family1/c6d2a3c7524d4e14a414c4b5cb972b2d, entries=4, sequenceid=5, filesize=5.4 K 2023-03-11 22:55:11,283 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/84e7ece417189721cd2d8b7121fcfa8d/.tmp/family2/6e74c04fce9d49a299cf4aed735f59e2 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/84e7ece417189721cd2d8b7121fcfa8d/family2/6e74c04fce9d49a299cf4aed735f59e2 2023-03-11 22:55:11,287 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/84e7ece417189721cd2d8b7121fcfa8d/family2/6e74c04fce9d49a299cf4aed735f59e2, entries=2, sequenceid=5, filesize=5.1 K 2023-03-11 22:55:11,288 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 84e7ece417189721cd2d8b7121fcfa8d in 950ms, sequenceid=5, compaction requested=false 2023-03-11 22:55:11,289 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 84e7ece417189721cd2d8b7121fcfa8d: 2023-03-11 22:55:11,289 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1678575308200.84e7ece417189721cd2d8b7121fcfa8d. 2023-03-11 22:55:11,289 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-11 22:55:11,626 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023031194302b017d91496e8c9e65063cc967ae to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e2023031194302b017d91496e8c9e65063cc967ae 2023-03-11 22:55:11,627 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202303119f16c16430e74c18af2f95948360a809 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b202303119f16c16430e74c18af2f95948360a809 2023-03-11 22:55:11,636 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/1d03ff70922c0981304d6eab43d86f2b/.tmp/family2/d8595da5b734464bb332f5c5bd99b949 2023-03-11 22:55:11,640 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/7087f753e6d78287d81e1391b6bb5914/.tmp/family2/330e0b0654ec460aa77b6ba2249ac84d 2023-03-11 22:55:11,651 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/1d03ff70922c0981304d6eab43d86f2b/.tmp/family1/edce420e22de4221ba94f161a4402cfc as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/1d03ff70922c0981304d6eab43d86f2b/family1/edce420e22de4221ba94f161a4402cfc 2023-03-11 22:55:11,653 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/7087f753e6d78287d81e1391b6bb5914/.tmp/family1/efeab45737fd42878d7dd3070ea2b1ce as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/7087f753e6d78287d81e1391b6bb5914/family1/efeab45737fd42878d7dd3070ea2b1ce 2023-03-11 22:55:11,657 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/7087f753e6d78287d81e1391b6bb5914/family1/efeab45737fd42878d7dd3070ea2b1ce, entries=4, sequenceid=5, filesize=5.4 K 2023-03-11 22:55:11,658 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/7087f753e6d78287d81e1391b6bb5914/.tmp/family2/330e0b0654ec460aa77b6ba2249ac84d as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/7087f753e6d78287d81e1391b6bb5914/family2/330e0b0654ec460aa77b6ba2249ac84d 2023-03-11 22:55:11,660 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/1d03ff70922c0981304d6eab43d86f2b/family1/edce420e22de4221ba94f161a4402cfc, entries=4, sequenceid=5, filesize=5.4 K 2023-03-11 22:55:11,661 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/1d03ff70922c0981304d6eab43d86f2b/.tmp/family2/d8595da5b734464bb332f5c5bd99b949 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/1d03ff70922c0981304d6eab43d86f2b/family2/d8595da5b734464bb332f5c5bd99b949 2023-03-11 22:55:11,664 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/7087f753e6d78287d81e1391b6bb5914/family2/330e0b0654ec460aa77b6ba2249ac84d, entries=2, sequenceid=5, filesize=5.1 K 2023-03-11 22:55:11,665 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 7087f753e6d78287d81e1391b6bb5914 in 1326ms, sequenceid=5, compaction requested=false 2023-03-11 22:55:11,666 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7087f753e6d78287d81e1391b6bb5914: 2023-03-11 22:55:11,666 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1678575308200.7087f753e6d78287d81e1391b6bb5914. 2023-03-11 22:55:11,666 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-11 22:55:11,677 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/1d03ff70922c0981304d6eab43d86f2b/family2/d8595da5b734464bb332f5c5bd99b949, entries=2, sequenceid=5, filesize=5.1 K 2023-03-11 22:55:11,678 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 1d03ff70922c0981304d6eab43d86f2b in 1340ms, sequenceid=5, compaction requested=false 2023-03-11 22:55:11,678 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 1d03ff70922c0981304d6eab43d86f2b: 2023-03-11 22:55:11,678 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1678575308200.1d03ff70922c0981304d6eab43d86f2b. 2023-03-11 22:55:11,678 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-11 22:55:11,679 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-11 22:55:11,679 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:11,679 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-03-11 22:55:11,679 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-03-11 22:55:11,686 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:11,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:11,686 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-11 22:55:11,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:55:11,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:55:11,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:55:11,691 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-11 22:55:11,691 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 22:55:11,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:55:11,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-11 22:55:11,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:11,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:55:11,698 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-03-11 22:55:11,698 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@43fc242e[Count = 0] remaining members to acquire global barrier 2023-03-11 22:55:11,698 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-03-11 22:55:11,698 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-11 22:55:11,700 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:11,700 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 22:55:11,703 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-11 22:55:11,703 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-11 22:55:11,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-11 22:55:11,703 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-03-11 22:55:11,703 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-03-11 22:55:11,703 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase20.apache.org,41843,1678575183185' in zk 2023-03-11 22:55:11,704 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:11,704 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-03-11 22:55:11,704 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:55:11,704 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-03-11 22:55:11,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:11,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:55:11,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:55:11,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:55:11,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:55:11,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-11 22:55:11,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:11,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:55:11,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-11 22:55:11,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:11,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase20.apache.org,41843,1678575183185': 2023-03-11 22:55:11,706 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-03-11 22:55:11,706 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-03-11 22:55:11,706 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 22:55:11,706 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 22:55:11,706 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-03-11 22:55:11,706 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 22:55:11,707 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-11 22:55:11,707 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-11 22:55:11,707 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-11 22:55:11,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-11 22:55:11,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-11 22:55:11,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:55:11,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:55:11,707 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:55:11,708 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:11,708 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:55:11,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:55:11,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:55:11,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-11 22:55:11,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-11 22:55:11,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:55:11,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-11 22:55:11,709 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:11,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:11,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:55:11,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-11 22:55:11,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:11,718 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:55:11,719 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:55:11,719 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:55:11,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:55:11,719 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:11,719 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-11 22:55:11,719 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-11 22:55:11,719 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:11,719 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-11 22:55:11,719 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-11 22:55:11,719 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-11 22:55:11,719 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:55:11,719 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:55:11,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:55:11,719 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-03-11 22:55:11,719 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 22:55:11,719 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-03-11 22:55:11,720 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-03-11 22:55:11,720 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 22:55:11,820 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 22:55:11,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 22:55:11,822 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1678575308200.1d03ff70922c0981304d6eab43d86f2b. with WAL disabled. Data may be lost in the event of a crash. 2023-03-11 22:55:11,822 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1678575308200.7087f753e6d78287d81e1391b6bb5914. with WAL disabled. Data may be lost in the event of a crash. 2023-03-11 22:55:11,823 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1678575308200.84e7ece417189721cd2d8b7121fcfa8d. with WAL disabled. Data may be lost in the event of a crash. 2023-03-11 22:55:11,825 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-11 22:55:11,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-03-11 22:55:11,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-03-11 22:55:11,829 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-03-11 22:55:11,829 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:55:11,829 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-03-11 22:55:11,829 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-03-11 22:55:11,831 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-11 22:55:11,831 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-11 22:55:11,832 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:55:11,833 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:55:11,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:55:11,833 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:11,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-11 22:55:11,833 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:11,833 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 22:55:11,833 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-11 22:55:11,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 22:55:11,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-11 22:55:11,834 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-03-11 22:55:11,834 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-03-11 22:55:11,834 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-03-11 22:55:11,834 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-03-11 22:55:11,834 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:55:11,834 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-03-11 22:55:11,836 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1678575308200.7087f753e6d78287d81e1391b6bb5914. 2023-03-11 22:55:11,837 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1678575308200.7087f753e6d78287d81e1391b6bb5914. started... 2023-03-11 22:55:11,837 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 7087f753e6d78287d81e1391b6bb5914 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-03-11 22:55:11,837 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1678575308200.1d03ff70922c0981304d6eab43d86f2b. 2023-03-11 22:55:11,837 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1678575308200.1d03ff70922c0981304d6eab43d86f2b. started... 2023-03-11 22:55:11,837 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 1d03ff70922c0981304d6eab43d86f2b 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-03-11 22:55:11,838 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-11 22:55:11,838 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 22:55:11,838 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1678575308200.84e7ece417189721cd2d8b7121fcfa8d. 2023-03-11 22:55:11,838 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1678575308200.84e7ece417189721cd2d8b7121fcfa8d. started... 2023-03-11 22:55:11,838 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 84e7ece417189721cd2d8b7121fcfa8d 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-03-11 22:55:11,870 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230311d77f356436cd4a28ae0eed00e9939646 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230311d77f356436cd4a28ae0eed00e9939646 2023-03-11 22:55:11,877 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230311ca68e25584084ab1a2955b18e331b7f1 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230311ca68e25584084ab1a2955b18e331b7f1 2023-03-11 22:55:11,908 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/84e7ece417189721cd2d8b7121fcfa8d/.tmp/family1/251063ce4a214430908e42b3e09b6e89 2023-03-11 22:55:11,942 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303112b9bb8d248a2483ba27374934cfbc869 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c202303112b9bb8d248a2483ba27374934cfbc869 2023-03-11 22:55:11,957 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/84e7ece417189721cd2d8b7121fcfa8d/.tmp/family2/50b5176542214b91b31474ccb0c45e5f 2023-03-11 22:55:11,962 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/84e7ece417189721cd2d8b7121fcfa8d/.tmp/family1/251063ce4a214430908e42b3e09b6e89 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/84e7ece417189721cd2d8b7121fcfa8d/family1/251063ce4a214430908e42b3e09b6e89 2023-03-11 22:55:11,966 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/84e7ece417189721cd2d8b7121fcfa8d/family1/251063ce4a214430908e42b3e09b6e89, entries=4, sequenceid=9, filesize=5.4 K 2023-03-11 22:55:11,967 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/84e7ece417189721cd2d8b7121fcfa8d/.tmp/family2/50b5176542214b91b31474ccb0c45e5f as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/84e7ece417189721cd2d8b7121fcfa8d/family2/50b5176542214b91b31474ccb0c45e5f 2023-03-11 22:55:11,972 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/84e7ece417189721cd2d8b7121fcfa8d/family2/50b5176542214b91b31474ccb0c45e5f, entries=2, sequenceid=9, filesize=5.1 K 2023-03-11 22:55:11,973 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 84e7ece417189721cd2d8b7121fcfa8d in 135ms, sequenceid=9, compaction requested=false 2023-03-11 22:55:11,973 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 84e7ece417189721cd2d8b7121fcfa8d: 2023-03-11 22:55:11,973 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1678575308200.84e7ece417189721cd2d8b7121fcfa8d. 2023-03-11 22:55:11,973 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-11 22:55:12,265 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023031110bbdd354bdf46cebfbb85ae7819c003 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e2023031110bbdd354bdf46cebfbb85ae7819c003 2023-03-11 22:55:12,299 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/7087f753e6d78287d81e1391b6bb5914/.tmp/family1/f525d2fd1a58417a83943454f6123487 2023-03-11 22:55:12,673 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/1d03ff70922c0981304d6eab43d86f2b/.tmp/family1/f08765817f9849bdb8501ecab1af1ad3 2023-03-11 22:55:12,696 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230311516eb2b567554fc5af925f22499ca69a to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20230311516eb2b567554fc5af925f22499ca69a 2023-03-11 22:55:12,703 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/1d03ff70922c0981304d6eab43d86f2b/.tmp/family2/198c5ac7477a4b45b6ef94c1621fd52a 2023-03-11 22:55:12,706 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/1d03ff70922c0981304d6eab43d86f2b/.tmp/family1/f08765817f9849bdb8501ecab1af1ad3 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/1d03ff70922c0981304d6eab43d86f2b/family1/f08765817f9849bdb8501ecab1af1ad3 2023-03-11 22:55:12,711 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/1d03ff70922c0981304d6eab43d86f2b/family1/f08765817f9849bdb8501ecab1af1ad3, entries=4, sequenceid=9, filesize=5.4 K 2023-03-11 22:55:12,711 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/1d03ff70922c0981304d6eab43d86f2b/.tmp/family2/198c5ac7477a4b45b6ef94c1621fd52a as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/1d03ff70922c0981304d6eab43d86f2b/family2/198c5ac7477a4b45b6ef94c1621fd52a 2023-03-11 22:55:12,718 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230311e85d148430c24355abdc6242209f8a18 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20230311e85d148430c24355abdc6242209f8a18 2023-03-11 22:55:12,721 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/1d03ff70922c0981304d6eab43d86f2b/family2/198c5ac7477a4b45b6ef94c1621fd52a, entries=2, sequenceid=9, filesize=5.1 K 2023-03-11 22:55:12,722 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 1d03ff70922c0981304d6eab43d86f2b in 885ms, sequenceid=9, compaction requested=false 2023-03-11 22:55:12,722 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 1d03ff70922c0981304d6eab43d86f2b: 2023-03-11 22:55:12,722 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1678575308200.1d03ff70922c0981304d6eab43d86f2b. 2023-03-11 22:55:12,722 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-11 22:55:13,129 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/7087f753e6d78287d81e1391b6bb5914/.tmp/family2/4722eb13dd844fcaaa3fec19aae7389e 2023-03-11 22:55:13,134 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/7087f753e6d78287d81e1391b6bb5914/.tmp/family1/f525d2fd1a58417a83943454f6123487 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/7087f753e6d78287d81e1391b6bb5914/family1/f525d2fd1a58417a83943454f6123487 2023-03-11 22:55:13,137 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/7087f753e6d78287d81e1391b6bb5914/family1/f525d2fd1a58417a83943454f6123487, entries=4, sequenceid=9, filesize=5.4 K 2023-03-11 22:55:13,138 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/7087f753e6d78287d81e1391b6bb5914/.tmp/family2/4722eb13dd844fcaaa3fec19aae7389e as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/7087f753e6d78287d81e1391b6bb5914/family2/4722eb13dd844fcaaa3fec19aae7389e 2023-03-11 22:55:13,142 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/7087f753e6d78287d81e1391b6bb5914/family2/4722eb13dd844fcaaa3fec19aae7389e, entries=2, sequenceid=9, filesize=5.1 K 2023-03-11 22:55:13,142 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 7087f753e6d78287d81e1391b6bb5914 in 1305ms, sequenceid=9, compaction requested=false 2023-03-11 22:55:13,142 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7087f753e6d78287d81e1391b6bb5914: 2023-03-11 22:55:13,142 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1678575308200.7087f753e6d78287d81e1391b6bb5914. 2023-03-11 22:55:13,143 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-11 22:55:13,143 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-11 22:55:13,143 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:13,143 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-03-11 22:55:13,143 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-03-11 22:55:13,145 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-11 22:55:13,145 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:13,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:13,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:55:13,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:55:13,145 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-11 22:55:13,145 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 22:55:13,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:55:13,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:55:13,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-11 22:55:13,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:13,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:55:13,151 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-03-11 22:55:13,151 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7e644754[Count = 0] remaining members to acquire global barrier 2023-03-11 22:55:13,151 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-03-11 22:55:13,152 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-11 22:55:13,153 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-11 22:55:13,153 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-11 22:55:13,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-11 22:55:13,153 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-03-11 22:55:13,153 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-03-11 22:55:13,153 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:13,153 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 22:55:13,153 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase20.apache.org,41843,1678575183185' in zk 2023-03-11 22:55:13,154 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-03-11 22:55:13,154 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:55:13,154 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-03-11 22:55:13,154 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:13,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:13,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:55:13,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:55:13,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:55:13,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:55:13,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-11 22:55:13,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:13,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:55:13,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-11 22:55:13,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:13,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase20.apache.org,41843,1678575183185': 2023-03-11 22:55:13,157 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-03-11 22:55:13,157 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-03-11 22:55:13,158 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 22:55:13,158 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 22:55:13,158 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-03-11 22:55:13,158 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 22:55:13,159 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-11 22:55:13,159 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-11 22:55:13,159 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-11 22:55:13,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-11 22:55:13,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-11 22:55:13,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:55:13,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:55:13,159 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:55:13,159 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:55:13,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:55:13,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-11 22:55:13,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:55:13,160 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:13,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-11 22:55:13,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:55:13,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-11 22:55:13,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:13,162 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:13,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:55:13,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-11 22:55:13,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:13,168 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:13,168 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-11 22:55:13,168 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-11 22:55:13,168 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:13,168 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:55:13,168 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-03-11 22:55:13,168 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-03-11 22:55:13,168 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 22:55:13,168 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-11 22:55:13,168 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-11 22:55:13,168 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-11 22:55:13,169 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-03-11 22:55:13,169 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 22:55:13,169 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:55:13,169 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:55:13,169 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:55:13,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:55:13,170 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:55:13,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:55:13,269 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 22:55:13,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 22:55:13,271 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1678575308200.1d03ff70922c0981304d6eab43d86f2b. with WAL disabled. Data may be lost in the event of a crash. 2023-03-11 22:55:13,271 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1678575308200.7087f753e6d78287d81e1391b6bb5914. with WAL disabled. Data may be lost in the event of a crash. 2023-03-11 22:55:13,271 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1678575308200.84e7ece417189721cd2d8b7121fcfa8d. with WAL disabled. Data may be lost in the event of a crash. 2023-03-11 22:55:13,273 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-11 22:55:13,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-03-11 22:55:13,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-03-11 22:55:13,275 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-03-11 22:55:13,275 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:55:13,275 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-03-11 22:55:13,275 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-03-11 22:55:13,275 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-11 22:55:13,276 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-11 22:55:13,276 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:55:13,276 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:13,276 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:55:13,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:55:13,277 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:13,277 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 22:55:13,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-11 22:55:13,277 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-11 22:55:13,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 22:55:13,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-11 22:55:13,277 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-03-11 22:55:13,277 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-03-11 22:55:13,277 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-03-11 22:55:13,277 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-03-11 22:55:13,277 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:55:13,278 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-03-11 22:55:13,278 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1678575308200.7087f753e6d78287d81e1391b6bb5914. 2023-03-11 22:55:13,278 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1678575308200.7087f753e6d78287d81e1391b6bb5914. started... 2023-03-11 22:55:13,278 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1678575308200.1d03ff70922c0981304d6eab43d86f2b. 2023-03-11 22:55:13,278 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1678575308200.1d03ff70922c0981304d6eab43d86f2b. started... 2023-03-11 22:55:13,278 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 7087f753e6d78287d81e1391b6bb5914 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-03-11 22:55:13,278 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 1d03ff70922c0981304d6eab43d86f2b 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-03-11 22:55:13,278 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-11 22:55:13,278 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 22:55:13,278 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1678575308200.84e7ece417189721cd2d8b7121fcfa8d. 2023-03-11 22:55:13,278 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1678575308200.84e7ece417189721cd2d8b7121fcfa8d. started... 2023-03-11 22:55:13,278 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 84e7ece417189721cd2d8b7121fcfa8d 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-03-11 22:55:13,700 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303116ccb4bf814814ae38f16ce9a144a92af to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202303116ccb4bf814814ae38f16ce9a144a92af 2023-03-11 22:55:13,701 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303119dd88c145df74a4eb910b00d7b8104d8 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202303119dd88c145df74a4eb910b00d7b8104d8 2023-03-11 22:55:13,705 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023031195bd17632d4847fbb76594917f1ffd23 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b2023031195bd17632d4847fbb76594917f1ffd23 2023-03-11 22:55:13,710 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/7087f753e6d78287d81e1391b6bb5914/.tmp/family1/63ca5c29fb644a899c5e81981f7924d1 2023-03-11 22:55:13,711 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/84e7ece417189721cd2d8b7121fcfa8d/.tmp/family1/951f369e0b5d49edbd84089035890c2f 2023-03-11 22:55:13,733 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230311b99f05166079417e873babe797247035 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20230311b99f05166079417e873babe797247035 2023-03-11 22:55:13,737 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230311c216d6c99ef148698bc5e64943e718af to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20230311c216d6c99ef148698bc5e64943e718af 2023-03-11 22:55:13,746 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/7087f753e6d78287d81e1391b6bb5914/.tmp/family2/5b37e25effbe4e16a9b4c31c8f87dc6f 2023-03-11 22:55:13,748 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/84e7ece417189721cd2d8b7121fcfa8d/.tmp/family2/68b0e8c7014b4f3282f3b0d5c5e01b81 2023-03-11 22:55:13,758 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/7087f753e6d78287d81e1391b6bb5914/.tmp/family1/63ca5c29fb644a899c5e81981f7924d1 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/7087f753e6d78287d81e1391b6bb5914/family1/63ca5c29fb644a899c5e81981f7924d1 2023-03-11 22:55:13,763 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/84e7ece417189721cd2d8b7121fcfa8d/.tmp/family1/951f369e0b5d49edbd84089035890c2f as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/84e7ece417189721cd2d8b7121fcfa8d/family1/951f369e0b5d49edbd84089035890c2f 2023-03-11 22:55:13,764 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/7087f753e6d78287d81e1391b6bb5914/family1/63ca5c29fb644a899c5e81981f7924d1, entries=4, sequenceid=13, filesize=5.4 K 2023-03-11 22:55:13,765 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/7087f753e6d78287d81e1391b6bb5914/.tmp/family2/5b37e25effbe4e16a9b4c31c8f87dc6f as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/7087f753e6d78287d81e1391b6bb5914/family2/5b37e25effbe4e16a9b4c31c8f87dc6f 2023-03-11 22:55:13,770 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/84e7ece417189721cd2d8b7121fcfa8d/family1/951f369e0b5d49edbd84089035890c2f, entries=4, sequenceid=13, filesize=5.4 K 2023-03-11 22:55:13,771 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/84e7ece417189721cd2d8b7121fcfa8d/.tmp/family2/68b0e8c7014b4f3282f3b0d5c5e01b81 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/84e7ece417189721cd2d8b7121fcfa8d/family2/68b0e8c7014b4f3282f3b0d5c5e01b81 2023-03-11 22:55:13,772 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/7087f753e6d78287d81e1391b6bb5914/family2/5b37e25effbe4e16a9b4c31c8f87dc6f, entries=2, sequenceid=13, filesize=5.1 K 2023-03-11 22:55:13,773 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 7087f753e6d78287d81e1391b6bb5914 in 495ms, sequenceid=13, compaction requested=true 2023-03-11 22:55:13,773 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7087f753e6d78287d81e1391b6bb5914: 2023-03-11 22:55:13,773 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1678575308200.7087f753e6d78287d81e1391b6bb5914. 2023-03-11 22:55:13,773 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-11 22:55:13,774 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/84e7ece417189721cd2d8b7121fcfa8d/family2/68b0e8c7014b4f3282f3b0d5c5e01b81, entries=2, sequenceid=13, filesize=5.1 K 2023-03-11 22:55:13,774 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 84e7ece417189721cd2d8b7121fcfa8d in 496ms, sequenceid=13, compaction requested=true 2023-03-11 22:55:13,774 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 84e7ece417189721cd2d8b7121fcfa8d: 2023-03-11 22:55:13,774 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1678575308200.84e7ece417189721cd2d8b7121fcfa8d. 2023-03-11 22:55:13,775 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-11 22:55:14,109 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/1d03ff70922c0981304d6eab43d86f2b/.tmp/family1/ec0f8cdd0aa4495f8e092f072daceef2 2023-03-11 22:55:14,526 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023031132b145ccc91a4c82b9d9465ce08261c9 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e2023031132b145ccc91a4c82b9d9465ce08261c9 2023-03-11 22:55:14,863 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-11 22:55:14,933 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/1d03ff70922c0981304d6eab43d86f2b/.tmp/family2/a811ae6369254566b05a45a0fafcb35f 2023-03-11 22:55:14,938 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/1d03ff70922c0981304d6eab43d86f2b/.tmp/family1/ec0f8cdd0aa4495f8e092f072daceef2 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/1d03ff70922c0981304d6eab43d86f2b/family1/ec0f8cdd0aa4495f8e092f072daceef2 2023-03-11 22:55:14,943 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/1d03ff70922c0981304d6eab43d86f2b/family1/ec0f8cdd0aa4495f8e092f072daceef2, entries=4, sequenceid=13, filesize=5.4 K 2023-03-11 22:55:14,943 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/1d03ff70922c0981304d6eab43d86f2b/.tmp/family2/a811ae6369254566b05a45a0fafcb35f as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/1d03ff70922c0981304d6eab43d86f2b/family2/a811ae6369254566b05a45a0fafcb35f 2023-03-11 22:55:14,955 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-11 22:55:14,955 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x56bb74b2 to 127.0.0.1:51815 2023-03-11 22:55:14,955 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-11 22:55:14,956 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-11 22:55:14,956 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x534804c5 to 127.0.0.1:51815 2023-03-11 22:55:14,956 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-11 22:55:14,959 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/1d03ff70922c0981304d6eab43d86f2b/family2/a811ae6369254566b05a45a0fafcb35f, entries=2, sequenceid=13, filesize=5.1 K 2023-03-11 22:55:14,960 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 1d03ff70922c0981304d6eab43d86f2b in 1682ms, sequenceid=13, compaction requested=true 2023-03-11 22:55:14,960 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 1d03ff70922c0981304d6eab43d86f2b: 2023-03-11 22:55:14,960 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1678575308200.1d03ff70922c0981304d6eab43d86f2b. 2023-03-11 22:55:14,960 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-11 22:55:14,960 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-11 22:55:14,960 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:14,960 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-03-11 22:55:14,960 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-03-11 22:55:14,961 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:14,961 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-11 22:55:14,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:14,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:55:14,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:55:14,961 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-11 22:55:14,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:55:14,961 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 22:55:14,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:55:14,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-11 22:55:14,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:14,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:55:14,962 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-03-11 22:55:14,962 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@35e7e45f[Count = 0] remaining members to acquire global barrier 2023-03-11 22:55:14,962 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-03-11 22:55:14,962 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-11 22:55:14,963 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-11 22:55:14,963 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-11 22:55:14,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-11 22:55:14,963 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-03-11 22:55:14,963 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-03-11 22:55:14,963 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase20.apache.org,41843,1678575183185' in zk 2023-03-11 22:55:14,963 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:14,963 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 22:55:14,964 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:14,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:14,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:55:14,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:55:14,964 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-03-11 22:55:14,964 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:55:14,964 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-03-11 22:55:14,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:55:14,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:55:14,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-11 22:55:14,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:14,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:55:14,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-11 22:55:14,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:14,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase20.apache.org,41843,1678575183185': 2023-03-11 22:55:14,966 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-03-11 22:55:14,966 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-03-11 22:55:14,966 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 22:55:14,967 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 22:55:14,967 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-03-11 22:55:14,967 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 22:55:14,968 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-11 22:55:14,968 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-11 22:55:14,968 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:55:14,968 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-11 22:55:14,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-11 22:55:14,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-11 22:55:14,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:55:14,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:55:14,968 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:55:14,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:55:14,968 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:14,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:55:14,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-11 22:55:14,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-11 22:55:14,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:55:14,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-11 22:55:14,969 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:14,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:14,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:55:14,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-11 22:55:14,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:14,976 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:14,976 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:55:14,976 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:55:14,976 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-11 22:55:14,977 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-03-11 22:55:14,976 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:55:14,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:55:14,976 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-03-11 22:55:14,978 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 22:55:14,976 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:55:14,977 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-11 22:55:14,978 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:14,978 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-11 22:55:14,978 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-11 22:55:14,978 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-11 22:55:14,978 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-03-11 22:55:14,978 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:55:14,979 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 22:55:14,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:55:15,079 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 22:55:15,080 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 22:55:15,081 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1678575308200.1d03ff70922c0981304d6eab43d86f2b. with WAL disabled. Data may be lost in the event of a crash. 2023-03-11 22:55:15,081 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1678575308200.7087f753e6d78287d81e1391b6bb5914. with WAL disabled. Data may be lost in the event of a crash. 2023-03-11 22:55:15,081 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1678575308200.84e7ece417189721cd2d8b7121fcfa8d. with WAL disabled. Data may be lost in the event of a crash. 2023-03-11 22:55:15,083 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-11 22:55:15,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-03-11 22:55:15,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-03-11 22:55:15,088 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-03-11 22:55:15,088 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:55:15,089 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-03-11 22:55:15,089 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-03-11 22:55:15,089 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-11 22:55:15,089 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-11 22:55:15,090 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:15,090 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:55:15,090 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:55:15,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:55:15,090 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:15,090 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 22:55:15,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-11 22:55:15,091 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-11 22:55:15,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 22:55:15,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-11 22:55:15,091 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-03-11 22:55:15,091 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-03-11 22:55:15,092 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-03-11 22:55:15,092 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-03-11 22:55:15,092 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:55:15,092 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-03-11 22:55:15,092 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1678575308200.7087f753e6d78287d81e1391b6bb5914. 2023-03-11 22:55:15,092 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1678575308200.7087f753e6d78287d81e1391b6bb5914. started... 2023-03-11 22:55:15,092 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 7087f753e6d78287d81e1391b6bb5914 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-03-11 22:55:15,093 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1678575308200.1d03ff70922c0981304d6eab43d86f2b. 2023-03-11 22:55:15,093 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-11 22:55:15,093 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 22:55:15,093 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1678575308200.84e7ece417189721cd2d8b7121fcfa8d. 2023-03-11 22:55:15,093 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1678575308200.84e7ece417189721cd2d8b7121fcfa8d. started... 2023-03-11 22:55:15,093 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 84e7ece417189721cd2d8b7121fcfa8d 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-03-11 22:55:15,093 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1678575308200.1d03ff70922c0981304d6eab43d86f2b. started... 2023-03-11 22:55:15,094 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 1d03ff70922c0981304d6eab43d86f2b 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-03-11 22:55:15,118 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230311e2ff5fecdfd14294b82686de1bda3572 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230311e2ff5fecdfd14294b82686de1bda3572 2023-03-11 22:55:15,127 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230311d48250c92d454b839c622117f9f808a2 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230311d48250c92d454b839c622117f9f808a2 2023-03-11 22:55:15,517 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230311f1fa23ebebf447ff8f67e74ab3076377 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20230311f1fa23ebebf447ff8f67e74ab3076377 2023-03-11 22:55:15,524 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/84e7ece417189721cd2d8b7121fcfa8d/.tmp/family1/6dabbba406a54a56b7256ce667ab1c20 2023-03-11 22:55:15,538 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/7087f753e6d78287d81e1391b6bb5914/.tmp/family1/249cd63c6e2f4b998e0b684be425ee7b 2023-03-11 22:55:15,558 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230311097f9dbeaf554fae9e61a3a17ccf5a51 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20230311097f9dbeaf554fae9e61a3a17ccf5a51 2023-03-11 22:55:15,569 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/7087f753e6d78287d81e1391b6bb5914/.tmp/family2/bad2bca117d34510937b6b3e77f0aafd 2023-03-11 22:55:15,574 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/7087f753e6d78287d81e1391b6bb5914/.tmp/family1/249cd63c6e2f4b998e0b684be425ee7b as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/7087f753e6d78287d81e1391b6bb5914/family1/249cd63c6e2f4b998e0b684be425ee7b 2023-03-11 22:55:15,580 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/7087f753e6d78287d81e1391b6bb5914/family1/249cd63c6e2f4b998e0b684be425ee7b, entries=4, sequenceid=17, filesize=5.4 K 2023-03-11 22:55:15,581 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/7087f753e6d78287d81e1391b6bb5914/.tmp/family2/bad2bca117d34510937b6b3e77f0aafd as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/7087f753e6d78287d81e1391b6bb5914/family2/bad2bca117d34510937b6b3e77f0aafd 2023-03-11 22:55:15,584 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/7087f753e6d78287d81e1391b6bb5914/family2/bad2bca117d34510937b6b3e77f0aafd, entries=2, sequenceid=17, filesize=5.1 K 2023-03-11 22:55:15,584 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 7087f753e6d78287d81e1391b6bb5914 in 492ms, sequenceid=17, compaction requested=true 2023-03-11 22:55:15,584 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7087f753e6d78287d81e1391b6bb5914: 2023-03-11 22:55:15,585 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1678575308200.7087f753e6d78287d81e1391b6bb5914. 2023-03-11 22:55:15,585 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-11 22:55:15,922 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/1d03ff70922c0981304d6eab43d86f2b/.tmp/family1/716edb21a7ce48619b81949bd21eb93e 2023-03-11 22:55:15,939 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230311d0d23aa7313f47a4bc682e6529075615 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20230311d0d23aa7313f47a4bc682e6529075615 2023-03-11 22:55:15,941 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303110928215e63264216b551881456a9dcd1 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e202303110928215e63264216b551881456a9dcd1 2023-03-11 22:55:16,346 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/84e7ece417189721cd2d8b7121fcfa8d/.tmp/family2/8426df7308a5403ea1df7f36801672d4 2023-03-11 22:55:16,352 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/84e7ece417189721cd2d8b7121fcfa8d/.tmp/family1/6dabbba406a54a56b7256ce667ab1c20 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/84e7ece417189721cd2d8b7121fcfa8d/family1/6dabbba406a54a56b7256ce667ab1c20 2023-03-11 22:55:16,352 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/1d03ff70922c0981304d6eab43d86f2b/.tmp/family2/d45b218e224142dc8664d8e1bea79b82 2023-03-11 22:55:16,363 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/1d03ff70922c0981304d6eab43d86f2b/.tmp/family1/716edb21a7ce48619b81949bd21eb93e as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/1d03ff70922c0981304d6eab43d86f2b/family1/716edb21a7ce48619b81949bd21eb93e 2023-03-11 22:55:16,364 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/84e7ece417189721cd2d8b7121fcfa8d/family1/6dabbba406a54a56b7256ce667ab1c20, entries=4, sequenceid=17, filesize=5.4 K 2023-03-11 22:55:16,365 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/84e7ece417189721cd2d8b7121fcfa8d/.tmp/family2/8426df7308a5403ea1df7f36801672d4 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/84e7ece417189721cd2d8b7121fcfa8d/family2/8426df7308a5403ea1df7f36801672d4 2023-03-11 22:55:16,368 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/1d03ff70922c0981304d6eab43d86f2b/family1/716edb21a7ce48619b81949bd21eb93e, entries=4, sequenceid=17, filesize=5.4 K 2023-03-11 22:55:16,368 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/1d03ff70922c0981304d6eab43d86f2b/.tmp/family2/d45b218e224142dc8664d8e1bea79b82 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/1d03ff70922c0981304d6eab43d86f2b/family2/d45b218e224142dc8664d8e1bea79b82 2023-03-11 22:55:16,374 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/84e7ece417189721cd2d8b7121fcfa8d/family2/8426df7308a5403ea1df7f36801672d4, entries=2, sequenceid=17, filesize=5.1 K 2023-03-11 22:55:16,374 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/1d03ff70922c0981304d6eab43d86f2b/family2/d45b218e224142dc8664d8e1bea79b82, entries=2, sequenceid=17, filesize=5.1 K 2023-03-11 22:55:16,374 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 84e7ece417189721cd2d8b7121fcfa8d in 1281ms, sequenceid=17, compaction requested=true 2023-03-11 22:55:16,374 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 84e7ece417189721cd2d8b7121fcfa8d: 2023-03-11 22:55:16,374 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1678575308200.84e7ece417189721cd2d8b7121fcfa8d. 2023-03-11 22:55:16,375 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-11 22:55:16,375 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 1d03ff70922c0981304d6eab43d86f2b in 1281ms, sequenceid=17, compaction requested=true 2023-03-11 22:55:16,375 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 1d03ff70922c0981304d6eab43d86f2b: 2023-03-11 22:55:16,375 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1678575308200.1d03ff70922c0981304d6eab43d86f2b. 2023-03-11 22:55:16,375 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-11 22:55:16,375 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-11 22:55:16,375 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:16,375 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-03-11 22:55:16,375 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-03-11 22:55:16,376 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:16,376 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-11 22:55:16,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:16,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:55:16,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:55:16,376 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-11 22:55:16,376 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 22:55:16,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:55:16,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:55:16,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-11 22:55:16,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:16,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:55:16,377 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-03-11 22:55:16,377 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5dfd939f[Count = 0] remaining members to acquire global barrier 2023-03-11 22:55:16,377 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-03-11 22:55:16,377 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-11 22:55:16,377 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-11 22:55:16,377 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-11 22:55:16,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-11 22:55:16,377 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-03-11 22:55:16,377 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-03-11 22:55:16,377 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:16,377 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 22:55:16,377 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase20.apache.org,41843,1678575183185' in zk 2023-03-11 22:55:16,378 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-03-11 22:55:16,378 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:16,378 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:55:16,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:16,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:55:16,378 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-03-11 22:55:16,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:55:16,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:55:16,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:55:16,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-11 22:55:16,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:16,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:55:16,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-11 22:55:16,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:16,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase20.apache.org,41843,1678575183185': 2023-03-11 22:55:16,384 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-03-11 22:55:16,384 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-03-11 22:55:16,384 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 22:55:16,384 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 22:55:16,384 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-03-11 22:55:16,384 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 22:55:16,385 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-11 22:55:16,385 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-11 22:55:16,385 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:55:16,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-11 22:55:16,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:55:16,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:55:16,385 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-11 22:55:16,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-11 22:55:16,385 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:16,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:55:16,385 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:55:16,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:55:16,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-11 22:55:16,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-11 22:55:16,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:55:16,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-11 22:55:16,387 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:16,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:16,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:55:16,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-11 22:55:16,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:16,401 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:16,401 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-11 22:55:16,401 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:55:16,401 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:55:16,401 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:55:16,401 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-03-11 22:55:16,401 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 22:55:16,401 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-11 22:55:16,401 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:16,401 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-11 22:55:16,401 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-11 22:55:16,401 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-11 22:55:16,401 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:55:16,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:55:16,402 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-03-11 22:55:16,402 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 22:55:16,402 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-03-11 22:55:16,402 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:55:16,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:55:16,502 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 22:55:16,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 22:55:16,515 DEBUG [Listener at localhost.localdomain/41563] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-11 22:55:16,530 DEBUG [Listener at localhost.localdomain/41563] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-11 22:55:16,544 DEBUG [Listener at localhost.localdomain/41563] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-11 22:55:16,544 DEBUG [Listener at localhost.localdomain/41563] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-11 22:55:16,579 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-11 22:55:16,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-03-11 22:55:16,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-03-11 22:55:16,581 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-03-11 22:55:16,581 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:55:16,582 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-03-11 22:55:16,582 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-03-11 22:55:16,582 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-11 22:55:16,582 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-11 22:55:16,582 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:55:16,583 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:16,583 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:55:16,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:55:16,583 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:16,583 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 22:55:16,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-11 22:55:16,583 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-11 22:55:16,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 22:55:16,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-11 22:55:16,583 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-03-11 22:55:16,587 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-03-11 22:55:16,587 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-03-11 22:55:16,588 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-03-11 22:55:16,588 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:55:16,588 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-03-11 22:55:16,588 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1678575308200.7087f753e6d78287d81e1391b6bb5914. 2023-03-11 22:55:16,588 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1678575308200.7087f753e6d78287d81e1391b6bb5914. started... 2023-03-11 22:55:16,588 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1678575308200.1d03ff70922c0981304d6eab43d86f2b. 2023-03-11 22:55:16,588 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1678575308200.1d03ff70922c0981304d6eab43d86f2b. started... 2023-03-11 22:55:16,588 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 7087f753e6d78287d81e1391b6bb5914 2/2 column families, dataSize=138 B heapSize=944 B 2023-03-11 22:55:16,588 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 1d03ff70922c0981304d6eab43d86f2b 2/2 column families, dataSize=138 B heapSize=944 B 2023-03-11 22:55:16,589 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-11 22:55:16,589 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 22:55:16,589 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1678575308200.84e7ece417189721cd2d8b7121fcfa8d. 2023-03-11 22:55:16,589 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1678575308200.84e7ece417189721cd2d8b7121fcfa8d. started... 2023-03-11 22:55:16,589 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 84e7ece417189721cd2d8b7121fcfa8d 2/2 column families, dataSize=138 B heapSize=944 B 2023-03-11 22:55:16,630 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/84e7ece417189721cd2d8b7121fcfa8d/.tmp/family1/163f52d6a39b4531b307396bc287e414 2023-03-11 22:55:16,634 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/1d03ff70922c0981304d6eab43d86f2b/.tmp/family1/b4d53519ca31435b99ef506e14ffacdb 2023-03-11 22:55:16,634 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 163f52d6a39b4531b307396bc287e414 2023-03-11 22:55:16,637 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b4d53519ca31435b99ef506e14ffacdb 2023-03-11 22:55:17,030 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/7087f753e6d78287d81e1391b6bb5914/.tmp/family1/3171f598c7504e2c9780b4539f967e1b 2023-03-11 22:55:17,036 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3171f598c7504e2c9780b4539f967e1b 2023-03-11 22:55:17,064 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/1d03ff70922c0981304d6eab43d86f2b/.tmp/family2/5a14e02ef69342788588d488139cae78 2023-03-11 22:55:17,068 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5a14e02ef69342788588d488139cae78 2023-03-11 22:55:17,073 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/1d03ff70922c0981304d6eab43d86f2b/.tmp/family1/b4d53519ca31435b99ef506e14ffacdb as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/1d03ff70922c0981304d6eab43d86f2b/family1/b4d53519ca31435b99ef506e14ffacdb 2023-03-11 22:55:17,077 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b4d53519ca31435b99ef506e14ffacdb 2023-03-11 22:55:17,077 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/1d03ff70922c0981304d6eab43d86f2b/family1/b4d53519ca31435b99ef506e14ffacdb, entries=3, sequenceid=23, filesize=5.0 K 2023-03-11 22:55:17,082 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/1d03ff70922c0981304d6eab43d86f2b/.tmp/family2/5a14e02ef69342788588d488139cae78 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/1d03ff70922c0981304d6eab43d86f2b/family2/5a14e02ef69342788588d488139cae78 2023-03-11 22:55:17,096 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5a14e02ef69342788588d488139cae78 2023-03-11 22:55:17,096 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/1d03ff70922c0981304d6eab43d86f2b/family2/5a14e02ef69342788588d488139cae78, entries=1, sequenceid=23, filesize=5.0 K 2023-03-11 22:55:17,096 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 1d03ff70922c0981304d6eab43d86f2b in 508ms, sequenceid=23, compaction requested=true 2023-03-11 22:55:17,096 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 1d03ff70922c0981304d6eab43d86f2b: 2023-03-11 22:55:17,096 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1678575308200.1d03ff70922c0981304d6eab43d86f2b. 2023-03-11 22:55:17,096 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-11 22:55:17,448 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/7087f753e6d78287d81e1391b6bb5914/.tmp/family2/7a3ced0cae5846e2b528bbdcf63c6d2e 2023-03-11 22:55:17,448 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/84e7ece417189721cd2d8b7121fcfa8d/.tmp/family2/4ee2e92c7b8547768a6e8a457215c9fc 2023-03-11 22:55:17,456 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7a3ced0cae5846e2b528bbdcf63c6d2e 2023-03-11 22:55:17,457 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4ee2e92c7b8547768a6e8a457215c9fc 2023-03-11 22:55:17,458 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/7087f753e6d78287d81e1391b6bb5914/.tmp/family1/3171f598c7504e2c9780b4539f967e1b as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/7087f753e6d78287d81e1391b6bb5914/family1/3171f598c7504e2c9780b4539f967e1b 2023-03-11 22:55:17,459 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/84e7ece417189721cd2d8b7121fcfa8d/.tmp/family1/163f52d6a39b4531b307396bc287e414 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/84e7ece417189721cd2d8b7121fcfa8d/family1/163f52d6a39b4531b307396bc287e414 2023-03-11 22:55:17,462 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 163f52d6a39b4531b307396bc287e414 2023-03-11 22:55:17,462 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3171f598c7504e2c9780b4539f967e1b 2023-03-11 22:55:17,462 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/84e7ece417189721cd2d8b7121fcfa8d/family1/163f52d6a39b4531b307396bc287e414, entries=3, sequenceid=23, filesize=5.0 K 2023-03-11 22:55:17,462 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/7087f753e6d78287d81e1391b6bb5914/family1/3171f598c7504e2c9780b4539f967e1b, entries=3, sequenceid=23, filesize=5.0 K 2023-03-11 22:55:17,463 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/84e7ece417189721cd2d8b7121fcfa8d/.tmp/family2/4ee2e92c7b8547768a6e8a457215c9fc as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/84e7ece417189721cd2d8b7121fcfa8d/family2/4ee2e92c7b8547768a6e8a457215c9fc 2023-03-11 22:55:17,463 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/7087f753e6d78287d81e1391b6bb5914/.tmp/family2/7a3ced0cae5846e2b528bbdcf63c6d2e as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/7087f753e6d78287d81e1391b6bb5914/family2/7a3ced0cae5846e2b528bbdcf63c6d2e 2023-03-11 22:55:17,466 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7a3ced0cae5846e2b528bbdcf63c6d2e 2023-03-11 22:55:17,466 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4ee2e92c7b8547768a6e8a457215c9fc 2023-03-11 22:55:17,466 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/7087f753e6d78287d81e1391b6bb5914/family2/7a3ced0cae5846e2b528bbdcf63c6d2e, entries=1, sequenceid=23, filesize=5.0 K 2023-03-11 22:55:17,466 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/84e7ece417189721cd2d8b7121fcfa8d/family2/4ee2e92c7b8547768a6e8a457215c9fc, entries=1, sequenceid=23, filesize=5.0 K 2023-03-11 22:55:17,467 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 84e7ece417189721cd2d8b7121fcfa8d in 878ms, sequenceid=23, compaction requested=true 2023-03-11 22:55:17,467 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 7087f753e6d78287d81e1391b6bb5914 in 879ms, sequenceid=23, compaction requested=true 2023-03-11 22:55:17,467 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 84e7ece417189721cd2d8b7121fcfa8d: 2023-03-11 22:55:17,467 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7087f753e6d78287d81e1391b6bb5914: 2023-03-11 22:55:17,467 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1678575308200.84e7ece417189721cd2d8b7121fcfa8d. 2023-03-11 22:55:17,467 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1678575308200.7087f753e6d78287d81e1391b6bb5914. 2023-03-11 22:55:17,467 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-11 22:55:17,467 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-11 22:55:17,467 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-11 22:55:17,467 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:17,467 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-03-11 22:55:17,467 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-03-11 22:55:17,468 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:17,468 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-11 22:55:17,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:17,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:55:17,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:55:17,468 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-11 22:55:17,468 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 22:55:17,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:55:17,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:55:17,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-11 22:55:17,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:17,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:55:17,469 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-03-11 22:55:17,469 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7f82115a[Count = 0] remaining members to acquire global barrier 2023-03-11 22:55:17,469 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-03-11 22:55:17,469 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-11 22:55:17,471 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-11 22:55:17,471 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-11 22:55:17,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-11 22:55:17,471 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-03-11 22:55:17,471 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-03-11 22:55:17,471 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:17,471 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 22:55:17,471 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase20.apache.org,41843,1678575183185' in zk 2023-03-11 22:55:17,472 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-03-11 22:55:17,472 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:17,472 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:55:17,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:17,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:55:17,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:55:17,472 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-03-11 22:55:17,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:55:17,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:55:17,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-11 22:55:17,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:17,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:55:17,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-11 22:55:17,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:17,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase20.apache.org,41843,1678575183185': 2023-03-11 22:55:17,473 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-03-11 22:55:17,473 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-03-11 22:55:17,473 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 22:55:17,473 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 22:55:17,473 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-03-11 22:55:17,473 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 22:55:17,474 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-11 22:55:17,474 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-11 22:55:17,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-11 22:55:17,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:55:17,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:55:17,474 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-11 22:55:17,474 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:55:17,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-11 22:55:17,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:55:17,474 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:55:17,474 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:17,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:55:17,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-11 22:55:17,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-11 22:55:17,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:55:17,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-11 22:55:17,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:17,475 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:17,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:55:17,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-11 22:55:17,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:17,476 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:17,476 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-11 22:55:17,476 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-11 22:55:17,476 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:17,476 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-11 22:55:17,476 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-11 22:55:17,477 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-11 22:55:17,477 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:55:17,477 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-03-11 22:55:17,477 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 22:55:17,477 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:55:17,477 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:55:17,477 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:55:17,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:55:17,477 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-03-11 22:55:17,477 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 22:55:17,477 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:55:17,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:55:17,577 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 22:55:17,578 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 22:55:17,578 DEBUG [Listener at localhost.localdomain/41563] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-11 22:55:17,578 DEBUG [Listener at localhost.localdomain/41563] regionserver.HStore(1912): 7087f753e6d78287d81e1391b6bb5914/family1 is initiating major compaction (all files) 2023-03-11 22:55:17,578 INFO [Listener at localhost.localdomain/41563] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-11 22:55:17,579 INFO [Listener at localhost.localdomain/41563] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-11 22:55:17,579 INFO [Listener at localhost.localdomain/41563] regionserver.HRegion(2259): Starting compaction of 7087f753e6d78287d81e1391b6bb5914/family1 in ns:testMinorCompaction,1,1678575308200.7087f753e6d78287d81e1391b6bb5914. 2023-03-11 22:55:17,579 INFO [Listener at localhost.localdomain/41563] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/7087f753e6d78287d81e1391b6bb5914/family1/efeab45737fd42878d7dd3070ea2b1ce, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/7087f753e6d78287d81e1391b6bb5914/family1/f525d2fd1a58417a83943454f6123487, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/7087f753e6d78287d81e1391b6bb5914/family1/63ca5c29fb644a899c5e81981f7924d1, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/7087f753e6d78287d81e1391b6bb5914/family1/249cd63c6e2f4b998e0b684be425ee7b, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/7087f753e6d78287d81e1391b6bb5914/family1/3171f598c7504e2c9780b4539f967e1b] into tmpdir=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/7087f753e6d78287d81e1391b6bb5914/.tmp, totalSize=26.6 K 2023-03-11 22:55:17,580 DEBUG [Listener at localhost.localdomain/41563] compactions.Compactor(207): Compacting efeab45737fd42878d7dd3070ea2b1ce, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678575310326 2023-03-11 22:55:17,581 DEBUG [Listener at localhost.localdomain/41563] compactions.Compactor(207): Compacting f525d2fd1a58417a83943454f6123487, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678575311822 2023-03-11 22:55:17,581 DEBUG [Listener at localhost.localdomain/41563] compactions.Compactor(207): Compacting 63ca5c29fb644a899c5e81981f7924d1, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678575313271 2023-03-11 22:55:17,581 DEBUG [Listener at localhost.localdomain/41563] compactions.Compactor(207): Compacting 249cd63c6e2f4b998e0b684be425ee7b, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678575315081 2023-03-11 22:55:17,582 DEBUG [Listener at localhost.localdomain/41563] compactions.Compactor(207): Compacting 3171f598c7504e2c9780b4539f967e1b, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-11 22:55:17,597 INFO [Listener at localhost.localdomain/41563] throttle.PressureAwareThroughputController(145): 7087f753e6d78287d81e1391b6bb5914#family1#compaction#150 average throughput is 0.33 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-11 22:55:17,607 INFO [Listener at localhost.localdomain/41563] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b2023031138f62ac5f4b44d169a8b3f5a86e5d41e_del 2023-03-11 22:55:17,607 INFO [Listener at localhost.localdomain/41563] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023031138f62ac5f4b44d169a8b3f5a86e5d41e_del to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b2023031138f62ac5f4b44d169a8b3f5a86e5d41e_del 2023-03-11 22:55:17,636 INFO [Listener at localhost.localdomain/41563] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2bc47566d88f49ddb50e9ebfa42077cd 2023-03-11 22:55:17,636 DEBUG [Listener at localhost.localdomain/41563] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/7087f753e6d78287d81e1391b6bb5914/.tmp/family1/2bc47566d88f49ddb50e9ebfa42077cd as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/7087f753e6d78287d81e1391b6bb5914/family1/2bc47566d88f49ddb50e9ebfa42077cd 2023-03-11 22:55:17,641 INFO [Listener at localhost.localdomain/41563] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2bc47566d88f49ddb50e9ebfa42077cd 2023-03-11 22:55:17,642 INFO [Listener at localhost.localdomain/41563] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 7087f753e6d78287d81e1391b6bb5914/family1 of 7087f753e6d78287d81e1391b6bb5914 into 2bc47566d88f49ddb50e9ebfa42077cd(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-11 22:55:17,642 DEBUG [Listener at localhost.localdomain/41563] regionserver.HRegion(2289): Compaction status journal for 7087f753e6d78287d81e1391b6bb5914: 2023-03-11 22:55:17,642 DEBUG [Listener at localhost.localdomain/41563] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-11 22:55:17,643 DEBUG [Listener at localhost.localdomain/41563] regionserver.HStore(1912): 7087f753e6d78287d81e1391b6bb5914/family2 is initiating major compaction (all files) 2023-03-11 22:55:17,643 INFO [Listener at localhost.localdomain/41563] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-11 22:55:17,643 INFO [Listener at localhost.localdomain/41563] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-11 22:55:17,643 INFO [Listener at localhost.localdomain/41563] regionserver.HRegion(2259): Starting compaction of 7087f753e6d78287d81e1391b6bb5914/family2 in ns:testMinorCompaction,1,1678575308200.7087f753e6d78287d81e1391b6bb5914. 2023-03-11 22:55:17,643 INFO [Listener at localhost.localdomain/41563] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/7087f753e6d78287d81e1391b6bb5914/family2/330e0b0654ec460aa77b6ba2249ac84d, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/7087f753e6d78287d81e1391b6bb5914/family2/4722eb13dd844fcaaa3fec19aae7389e, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/7087f753e6d78287d81e1391b6bb5914/family2/5b37e25effbe4e16a9b4c31c8f87dc6f, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/7087f753e6d78287d81e1391b6bb5914/family2/bad2bca117d34510937b6b3e77f0aafd, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/7087f753e6d78287d81e1391b6bb5914/family2/7a3ced0cae5846e2b528bbdcf63c6d2e] into tmpdir=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/7087f753e6d78287d81e1391b6bb5914/.tmp, totalSize=25.3 K 2023-03-11 22:55:17,644 DEBUG [Listener at localhost.localdomain/41563] compactions.Compactor(207): Compacting 330e0b0654ec460aa77b6ba2249ac84d, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678575310326 2023-03-11 22:55:17,644 DEBUG [Listener at localhost.localdomain/41563] compactions.Compactor(207): Compacting 4722eb13dd844fcaaa3fec19aae7389e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678575311822 2023-03-11 22:55:17,644 DEBUG [Listener at localhost.localdomain/41563] compactions.Compactor(207): Compacting 5b37e25effbe4e16a9b4c31c8f87dc6f, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678575313271 2023-03-11 22:55:17,644 DEBUG [Listener at localhost.localdomain/41563] compactions.Compactor(207): Compacting bad2bca117d34510937b6b3e77f0aafd, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678575315081 2023-03-11 22:55:17,645 DEBUG [Listener at localhost.localdomain/41563] compactions.Compactor(207): Compacting 7a3ced0cae5846e2b528bbdcf63c6d2e, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-11 22:55:17,655 INFO [Listener at localhost.localdomain/41563] throttle.PressureAwareThroughputController(145): 7087f753e6d78287d81e1391b6bb5914#family2#compaction#151 average throughput is 0.51 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-11 22:55:17,665 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/7087f753e6d78287d81e1391b6bb5914/family1/efeab45737fd42878d7dd3070ea2b1ce, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/7087f753e6d78287d81e1391b6bb5914/family1/f525d2fd1a58417a83943454f6123487, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/7087f753e6d78287d81e1391b6bb5914/family1/63ca5c29fb644a899c5e81981f7924d1, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/7087f753e6d78287d81e1391b6bb5914/family1/249cd63c6e2f4b998e0b684be425ee7b, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/7087f753e6d78287d81e1391b6bb5914/family1/3171f598c7504e2c9780b4539f967e1b] to archive 2023-03-11 22:55:17,667 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 22:55:17,668 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/7087f753e6d78287d81e1391b6bb5914/family1/efeab45737fd42878d7dd3070ea2b1ce to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/ns/testMinorCompaction/7087f753e6d78287d81e1391b6bb5914/family1/efeab45737fd42878d7dd3070ea2b1ce 2023-03-11 22:55:17,669 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/7087f753e6d78287d81e1391b6bb5914/family1/f525d2fd1a58417a83943454f6123487 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/ns/testMinorCompaction/7087f753e6d78287d81e1391b6bb5914/family1/f525d2fd1a58417a83943454f6123487 2023-03-11 22:55:17,671 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/7087f753e6d78287d81e1391b6bb5914/family1/63ca5c29fb644a899c5e81981f7924d1 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/ns/testMinorCompaction/7087f753e6d78287d81e1391b6bb5914/family1/63ca5c29fb644a899c5e81981f7924d1 2023-03-11 22:55:17,672 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/7087f753e6d78287d81e1391b6bb5914/family1/249cd63c6e2f4b998e0b684be425ee7b to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/ns/testMinorCompaction/7087f753e6d78287d81e1391b6bb5914/family1/249cd63c6e2f4b998e0b684be425ee7b 2023-03-11 22:55:17,672 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/7087f753e6d78287d81e1391b6bb5914/family1/3171f598c7504e2c9780b4539f967e1b to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/ns/testMinorCompaction/7087f753e6d78287d81e1391b6bb5914/family1/3171f598c7504e2c9780b4539f967e1b 2023-03-11 22:55:18,063 INFO [Listener at localhost.localdomain/41563] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230311ef4b081529a741dbaa258906ebed30c2_del 2023-03-11 22:55:18,063 INFO [Listener at localhost.localdomain/41563] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230311ef4b081529a741dbaa258906ebed30c2_del to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20230311ef4b081529a741dbaa258906ebed30c2_del 2023-03-11 22:55:18,091 INFO [Listener at localhost.localdomain/41563] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b9f79fd61e3148cc93827724302e708b 2023-03-11 22:55:18,092 DEBUG [Listener at localhost.localdomain/41563] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/7087f753e6d78287d81e1391b6bb5914/.tmp/family2/b9f79fd61e3148cc93827724302e708b as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/7087f753e6d78287d81e1391b6bb5914/family2/b9f79fd61e3148cc93827724302e708b 2023-03-11 22:55:18,096 INFO [Listener at localhost.localdomain/41563] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b9f79fd61e3148cc93827724302e708b 2023-03-11 22:55:18,096 INFO [Listener at localhost.localdomain/41563] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 7087f753e6d78287d81e1391b6bb5914/family2 of 7087f753e6d78287d81e1391b6bb5914 into b9f79fd61e3148cc93827724302e708b(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-11 22:55:18,096 DEBUG [Listener at localhost.localdomain/41563] regionserver.HRegion(2289): Compaction status journal for 7087f753e6d78287d81e1391b6bb5914: 2023-03-11 22:55:18,097 DEBUG [Listener at localhost.localdomain/41563] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-11 22:55:18,097 DEBUG [Listener at localhost.localdomain/41563] regionserver.HStore(1912): 1d03ff70922c0981304d6eab43d86f2b/family1 is initiating major compaction (all files) 2023-03-11 22:55:18,097 INFO [Listener at localhost.localdomain/41563] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-11 22:55:18,097 INFO [Listener at localhost.localdomain/41563] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-11 22:55:18,098 INFO [Listener at localhost.localdomain/41563] regionserver.HRegion(2259): Starting compaction of 1d03ff70922c0981304d6eab43d86f2b/family1 in ns:testMinorCompaction,,1678575308200.1d03ff70922c0981304d6eab43d86f2b. 2023-03-11 22:55:18,098 INFO [Listener at localhost.localdomain/41563] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/1d03ff70922c0981304d6eab43d86f2b/family1/edce420e22de4221ba94f161a4402cfc, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/1d03ff70922c0981304d6eab43d86f2b/family1/f08765817f9849bdb8501ecab1af1ad3, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/1d03ff70922c0981304d6eab43d86f2b/family1/ec0f8cdd0aa4495f8e092f072daceef2, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/1d03ff70922c0981304d6eab43d86f2b/family1/716edb21a7ce48619b81949bd21eb93e, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/1d03ff70922c0981304d6eab43d86f2b/family1/b4d53519ca31435b99ef506e14ffacdb] into tmpdir=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/1d03ff70922c0981304d6eab43d86f2b/.tmp, totalSize=26.6 K 2023-03-11 22:55:18,098 DEBUG [Listener at localhost.localdomain/41563] compactions.Compactor(207): Compacting edce420e22de4221ba94f161a4402cfc, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678575310325 2023-03-11 22:55:18,098 DEBUG [Listener at localhost.localdomain/41563] compactions.Compactor(207): Compacting f08765817f9849bdb8501ecab1af1ad3, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678575311822 2023-03-11 22:55:18,099 DEBUG [Listener at localhost.localdomain/41563] compactions.Compactor(207): Compacting ec0f8cdd0aa4495f8e092f072daceef2, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678575313271 2023-03-11 22:55:18,099 DEBUG [Listener at localhost.localdomain/41563] compactions.Compactor(207): Compacting 716edb21a7ce48619b81949bd21eb93e, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678575315081 2023-03-11 22:55:18,100 DEBUG [Listener at localhost.localdomain/41563] compactions.Compactor(207): Compacting b4d53519ca31435b99ef506e14ffacdb, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-11 22:55:18,108 INFO [Listener at localhost.localdomain/41563] throttle.PressureAwareThroughputController(145): 1d03ff70922c0981304d6eab43d86f2b#family1#compaction#152 average throughput is 0.83 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-11 22:55:18,164 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/7087f753e6d78287d81e1391b6bb5914/family2/330e0b0654ec460aa77b6ba2249ac84d, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/7087f753e6d78287d81e1391b6bb5914/family2/4722eb13dd844fcaaa3fec19aae7389e, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/7087f753e6d78287d81e1391b6bb5914/family2/5b37e25effbe4e16a9b4c31c8f87dc6f, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/7087f753e6d78287d81e1391b6bb5914/family2/bad2bca117d34510937b6b3e77f0aafd, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/7087f753e6d78287d81e1391b6bb5914/family2/7a3ced0cae5846e2b528bbdcf63c6d2e] to archive 2023-03-11 22:55:18,166 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 22:55:18,167 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/7087f753e6d78287d81e1391b6bb5914/family2/330e0b0654ec460aa77b6ba2249ac84d to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/ns/testMinorCompaction/7087f753e6d78287d81e1391b6bb5914/family2/330e0b0654ec460aa77b6ba2249ac84d 2023-03-11 22:55:18,170 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/7087f753e6d78287d81e1391b6bb5914/family2/4722eb13dd844fcaaa3fec19aae7389e to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/ns/testMinorCompaction/7087f753e6d78287d81e1391b6bb5914/family2/4722eb13dd844fcaaa3fec19aae7389e 2023-03-11 22:55:18,172 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/7087f753e6d78287d81e1391b6bb5914/family2/5b37e25effbe4e16a9b4c31c8f87dc6f to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/ns/testMinorCompaction/7087f753e6d78287d81e1391b6bb5914/family2/5b37e25effbe4e16a9b4c31c8f87dc6f 2023-03-11 22:55:18,173 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/7087f753e6d78287d81e1391b6bb5914/family2/bad2bca117d34510937b6b3e77f0aafd to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/ns/testMinorCompaction/7087f753e6d78287d81e1391b6bb5914/family2/bad2bca117d34510937b6b3e77f0aafd 2023-03-11 22:55:18,174 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/7087f753e6d78287d81e1391b6bb5914/family2/7a3ced0cae5846e2b528bbdcf63c6d2e to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/ns/testMinorCompaction/7087f753e6d78287d81e1391b6bb5914/family2/7a3ced0cae5846e2b528bbdcf63c6d2e 2023-03-11 22:55:18,523 INFO [Listener at localhost.localdomain/41563] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202303117dd9c5043c4c4a0da4e6b230ad8ab881_del 2023-03-11 22:55:18,524 INFO [Listener at localhost.localdomain/41563] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303117dd9c5043c4c4a0da4e6b230ad8ab881_del to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202303117dd9c5043c4c4a0da4e6b230ad8ab881_del 2023-03-11 22:55:18,943 INFO [Listener at localhost.localdomain/41563] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for df09ec8e6a6448b2ad44c01b952d8b4c 2023-03-11 22:55:18,945 DEBUG [Listener at localhost.localdomain/41563] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/1d03ff70922c0981304d6eab43d86f2b/.tmp/family1/df09ec8e6a6448b2ad44c01b952d8b4c as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/1d03ff70922c0981304d6eab43d86f2b/family1/df09ec8e6a6448b2ad44c01b952d8b4c 2023-03-11 22:55:18,951 INFO [Listener at localhost.localdomain/41563] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for df09ec8e6a6448b2ad44c01b952d8b4c 2023-03-11 22:55:18,952 INFO [Listener at localhost.localdomain/41563] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 1d03ff70922c0981304d6eab43d86f2b/family1 of 1d03ff70922c0981304d6eab43d86f2b into df09ec8e6a6448b2ad44c01b952d8b4c(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-11 22:55:18,952 DEBUG [Listener at localhost.localdomain/41563] regionserver.HRegion(2289): Compaction status journal for 1d03ff70922c0981304d6eab43d86f2b: 2023-03-11 22:55:18,952 DEBUG [Listener at localhost.localdomain/41563] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-11 22:55:18,953 DEBUG [Listener at localhost.localdomain/41563] regionserver.HStore(1912): 1d03ff70922c0981304d6eab43d86f2b/family2 is initiating major compaction (all files) 2023-03-11 22:55:18,953 INFO [Listener at localhost.localdomain/41563] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-11 22:55:18,953 INFO [Listener at localhost.localdomain/41563] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-11 22:55:18,953 INFO [Listener at localhost.localdomain/41563] regionserver.HRegion(2259): Starting compaction of 1d03ff70922c0981304d6eab43d86f2b/family2 in ns:testMinorCompaction,,1678575308200.1d03ff70922c0981304d6eab43d86f2b. 2023-03-11 22:55:18,953 INFO [Listener at localhost.localdomain/41563] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/1d03ff70922c0981304d6eab43d86f2b/family2/d8595da5b734464bb332f5c5bd99b949, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/1d03ff70922c0981304d6eab43d86f2b/family2/198c5ac7477a4b45b6ef94c1621fd52a, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/1d03ff70922c0981304d6eab43d86f2b/family2/a811ae6369254566b05a45a0fafcb35f, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/1d03ff70922c0981304d6eab43d86f2b/family2/d45b218e224142dc8664d8e1bea79b82, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/1d03ff70922c0981304d6eab43d86f2b/family2/5a14e02ef69342788588d488139cae78] into tmpdir=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/1d03ff70922c0981304d6eab43d86f2b/.tmp, totalSize=25.3 K 2023-03-11 22:55:18,954 DEBUG [Listener at localhost.localdomain/41563] compactions.Compactor(207): Compacting d8595da5b734464bb332f5c5bd99b949, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678575310325 2023-03-11 22:55:18,954 DEBUG [Listener at localhost.localdomain/41563] compactions.Compactor(207): Compacting 198c5ac7477a4b45b6ef94c1621fd52a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678575311822 2023-03-11 22:55:18,954 DEBUG [Listener at localhost.localdomain/41563] compactions.Compactor(207): Compacting a811ae6369254566b05a45a0fafcb35f, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678575313271 2023-03-11 22:55:18,955 DEBUG [Listener at localhost.localdomain/41563] compactions.Compactor(207): Compacting d45b218e224142dc8664d8e1bea79b82, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678575315081 2023-03-11 22:55:18,955 DEBUG [Listener at localhost.localdomain/41563] compactions.Compactor(207): Compacting 5a14e02ef69342788588d488139cae78, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-11 22:55:18,963 INFO [Listener at localhost.localdomain/41563] throttle.PressureAwareThroughputController(145): 1d03ff70922c0981304d6eab43d86f2b#family2#compaction#153 average throughput is 0.51 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-11 22:55:18,965 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/1d03ff70922c0981304d6eab43d86f2b/family1/edce420e22de4221ba94f161a4402cfc, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/1d03ff70922c0981304d6eab43d86f2b/family1/f08765817f9849bdb8501ecab1af1ad3, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/1d03ff70922c0981304d6eab43d86f2b/family1/ec0f8cdd0aa4495f8e092f072daceef2, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/1d03ff70922c0981304d6eab43d86f2b/family1/716edb21a7ce48619b81949bd21eb93e, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/1d03ff70922c0981304d6eab43d86f2b/family1/b4d53519ca31435b99ef506e14ffacdb] to archive 2023-03-11 22:55:18,966 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 22:55:18,967 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/1d03ff70922c0981304d6eab43d86f2b/family1/edce420e22de4221ba94f161a4402cfc to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/ns/testMinorCompaction/1d03ff70922c0981304d6eab43d86f2b/family1/edce420e22de4221ba94f161a4402cfc 2023-03-11 22:55:18,968 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/1d03ff70922c0981304d6eab43d86f2b/family1/f08765817f9849bdb8501ecab1af1ad3 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/ns/testMinorCompaction/1d03ff70922c0981304d6eab43d86f2b/family1/f08765817f9849bdb8501ecab1af1ad3 2023-03-11 22:55:18,968 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/1d03ff70922c0981304d6eab43d86f2b/family1/ec0f8cdd0aa4495f8e092f072daceef2 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/ns/testMinorCompaction/1d03ff70922c0981304d6eab43d86f2b/family1/ec0f8cdd0aa4495f8e092f072daceef2 2023-03-11 22:55:18,969 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/1d03ff70922c0981304d6eab43d86f2b/family1/716edb21a7ce48619b81949bd21eb93e to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/ns/testMinorCompaction/1d03ff70922c0981304d6eab43d86f2b/family1/716edb21a7ce48619b81949bd21eb93e 2023-03-11 22:55:18,970 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/1d03ff70922c0981304d6eab43d86f2b/family1/b4d53519ca31435b99ef506e14ffacdb to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/ns/testMinorCompaction/1d03ff70922c0981304d6eab43d86f2b/family1/b4d53519ca31435b99ef506e14ffacdb 2023-03-11 22:55:19,378 INFO [Listener at localhost.localdomain/41563] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e2023031114c7669f859645cc88edd9a43b9a5218_del 2023-03-11 22:55:19,378 INFO [Listener at localhost.localdomain/41563] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023031114c7669f859645cc88edd9a43b9a5218_del to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e2023031114c7669f859645cc88edd9a43b9a5218_del 2023-03-11 22:55:20,208 INFO [Listener at localhost.localdomain/41563] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f0287d37e71246508ba689cd3e1d5b25 2023-03-11 22:55:20,209 DEBUG [Listener at localhost.localdomain/41563] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/1d03ff70922c0981304d6eab43d86f2b/.tmp/family2/f0287d37e71246508ba689cd3e1d5b25 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/1d03ff70922c0981304d6eab43d86f2b/family2/f0287d37e71246508ba689cd3e1d5b25 2023-03-11 22:55:20,217 INFO [Listener at localhost.localdomain/41563] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f0287d37e71246508ba689cd3e1d5b25 2023-03-11 22:55:20,218 INFO [Listener at localhost.localdomain/41563] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 1d03ff70922c0981304d6eab43d86f2b/family2 of 1d03ff70922c0981304d6eab43d86f2b into f0287d37e71246508ba689cd3e1d5b25(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-11 22:55:20,218 DEBUG [Listener at localhost.localdomain/41563] regionserver.HRegion(2289): Compaction status journal for 1d03ff70922c0981304d6eab43d86f2b: 2023-03-11 22:55:20,218 DEBUG [Listener at localhost.localdomain/41563] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-11 22:55:20,219 DEBUG [Listener at localhost.localdomain/41563] regionserver.HStore(1912): 84e7ece417189721cd2d8b7121fcfa8d/family1 is initiating major compaction (all files) 2023-03-11 22:55:20,219 INFO [Listener at localhost.localdomain/41563] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-11 22:55:20,219 INFO [Listener at localhost.localdomain/41563] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-11 22:55:20,219 INFO [Listener at localhost.localdomain/41563] regionserver.HRegion(2259): Starting compaction of 84e7ece417189721cd2d8b7121fcfa8d/family1 in ns:testMinorCompaction,2,1678575308200.84e7ece417189721cd2d8b7121fcfa8d. 2023-03-11 22:55:20,219 INFO [Listener at localhost.localdomain/41563] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/84e7ece417189721cd2d8b7121fcfa8d/family1/c6d2a3c7524d4e14a414c4b5cb972b2d, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/84e7ece417189721cd2d8b7121fcfa8d/family1/251063ce4a214430908e42b3e09b6e89, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/84e7ece417189721cd2d8b7121fcfa8d/family1/951f369e0b5d49edbd84089035890c2f, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/84e7ece417189721cd2d8b7121fcfa8d/family1/6dabbba406a54a56b7256ce667ab1c20, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/84e7ece417189721cd2d8b7121fcfa8d/family1/163f52d6a39b4531b307396bc287e414] into tmpdir=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/84e7ece417189721cd2d8b7121fcfa8d/.tmp, totalSize=26.6 K 2023-03-11 22:55:20,220 DEBUG [Listener at localhost.localdomain/41563] compactions.Compactor(207): Compacting c6d2a3c7524d4e14a414c4b5cb972b2d, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678575310327 2023-03-11 22:55:20,220 DEBUG [Listener at localhost.localdomain/41563] compactions.Compactor(207): Compacting 251063ce4a214430908e42b3e09b6e89, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678575311823 2023-03-11 22:55:20,221 DEBUG [Listener at localhost.localdomain/41563] compactions.Compactor(207): Compacting 951f369e0b5d49edbd84089035890c2f, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678575313271 2023-03-11 22:55:20,221 DEBUG [Listener at localhost.localdomain/41563] compactions.Compactor(207): Compacting 6dabbba406a54a56b7256ce667ab1c20, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678575315081 2023-03-11 22:55:20,221 DEBUG [Listener at localhost.localdomain/41563] compactions.Compactor(207): Compacting 163f52d6a39b4531b307396bc287e414, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-11 22:55:20,233 INFO [Listener at localhost.localdomain/41563] throttle.PressureAwareThroughputController(145): 84e7ece417189721cd2d8b7121fcfa8d#family1#compaction#154 average throughput is 0.55 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-11 22:55:20,264 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/1d03ff70922c0981304d6eab43d86f2b/family2/d8595da5b734464bb332f5c5bd99b949, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/1d03ff70922c0981304d6eab43d86f2b/family2/198c5ac7477a4b45b6ef94c1621fd52a, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/1d03ff70922c0981304d6eab43d86f2b/family2/a811ae6369254566b05a45a0fafcb35f, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/1d03ff70922c0981304d6eab43d86f2b/family2/d45b218e224142dc8664d8e1bea79b82, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/1d03ff70922c0981304d6eab43d86f2b/family2/5a14e02ef69342788588d488139cae78] to archive 2023-03-11 22:55:20,265 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 22:55:20,267 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/1d03ff70922c0981304d6eab43d86f2b/family2/d8595da5b734464bb332f5c5bd99b949 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/ns/testMinorCompaction/1d03ff70922c0981304d6eab43d86f2b/family2/d8595da5b734464bb332f5c5bd99b949 2023-03-11 22:55:20,268 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/1d03ff70922c0981304d6eab43d86f2b/family2/198c5ac7477a4b45b6ef94c1621fd52a to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/ns/testMinorCompaction/1d03ff70922c0981304d6eab43d86f2b/family2/198c5ac7477a4b45b6ef94c1621fd52a 2023-03-11 22:55:20,269 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/1d03ff70922c0981304d6eab43d86f2b/family2/a811ae6369254566b05a45a0fafcb35f to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/ns/testMinorCompaction/1d03ff70922c0981304d6eab43d86f2b/family2/a811ae6369254566b05a45a0fafcb35f 2023-03-11 22:55:20,270 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/1d03ff70922c0981304d6eab43d86f2b/family2/d45b218e224142dc8664d8e1bea79b82 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/ns/testMinorCompaction/1d03ff70922c0981304d6eab43d86f2b/family2/d45b218e224142dc8664d8e1bea79b82 2023-03-11 22:55:20,272 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/1d03ff70922c0981304d6eab43d86f2b/family2/5a14e02ef69342788588d488139cae78 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/ns/testMinorCompaction/1d03ff70922c0981304d6eab43d86f2b/family2/5a14e02ef69342788588d488139cae78 2023-03-11 22:55:20,651 INFO [Listener at localhost.localdomain/41563] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202303113edb88f8708445a48194d3e6a2972f92_del 2023-03-11 22:55:20,652 INFO [Listener at localhost.localdomain/41563] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303113edb88f8708445a48194d3e6a2972f92_del to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202303113edb88f8708445a48194d3e6a2972f92_del 2023-03-11 22:55:21,072 INFO [Listener at localhost.localdomain/41563] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8fb3ddb7c8d34dca9fb69d18885754e9 2023-03-11 22:55:21,073 DEBUG [Listener at localhost.localdomain/41563] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/84e7ece417189721cd2d8b7121fcfa8d/.tmp/family1/8fb3ddb7c8d34dca9fb69d18885754e9 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/84e7ece417189721cd2d8b7121fcfa8d/family1/8fb3ddb7c8d34dca9fb69d18885754e9 2023-03-11 22:55:21,078 INFO [Listener at localhost.localdomain/41563] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8fb3ddb7c8d34dca9fb69d18885754e9 2023-03-11 22:55:21,079 INFO [Listener at localhost.localdomain/41563] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 84e7ece417189721cd2d8b7121fcfa8d/family1 of 84e7ece417189721cd2d8b7121fcfa8d into 8fb3ddb7c8d34dca9fb69d18885754e9(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-11 22:55:21,079 DEBUG [Listener at localhost.localdomain/41563] regionserver.HRegion(2289): Compaction status journal for 84e7ece417189721cd2d8b7121fcfa8d: 2023-03-11 22:55:21,079 DEBUG [Listener at localhost.localdomain/41563] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-11 22:55:21,079 DEBUG [Listener at localhost.localdomain/41563] regionserver.HStore(1912): 84e7ece417189721cd2d8b7121fcfa8d/family2 is initiating major compaction (all files) 2023-03-11 22:55:21,079 INFO [Listener at localhost.localdomain/41563] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-11 22:55:21,079 INFO [Listener at localhost.localdomain/41563] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-11 22:55:21,079 INFO [Listener at localhost.localdomain/41563] regionserver.HRegion(2259): Starting compaction of 84e7ece417189721cd2d8b7121fcfa8d/family2 in ns:testMinorCompaction,2,1678575308200.84e7ece417189721cd2d8b7121fcfa8d. 2023-03-11 22:55:21,080 INFO [Listener at localhost.localdomain/41563] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/84e7ece417189721cd2d8b7121fcfa8d/family2/6e74c04fce9d49a299cf4aed735f59e2, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/84e7ece417189721cd2d8b7121fcfa8d/family2/50b5176542214b91b31474ccb0c45e5f, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/84e7ece417189721cd2d8b7121fcfa8d/family2/68b0e8c7014b4f3282f3b0d5c5e01b81, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/84e7ece417189721cd2d8b7121fcfa8d/family2/8426df7308a5403ea1df7f36801672d4, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/84e7ece417189721cd2d8b7121fcfa8d/family2/4ee2e92c7b8547768a6e8a457215c9fc] into tmpdir=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/84e7ece417189721cd2d8b7121fcfa8d/.tmp, totalSize=25.3 K 2023-03-11 22:55:21,080 DEBUG [Listener at localhost.localdomain/41563] compactions.Compactor(207): Compacting 6e74c04fce9d49a299cf4aed735f59e2, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678575310327 2023-03-11 22:55:21,080 DEBUG [Listener at localhost.localdomain/41563] compactions.Compactor(207): Compacting 50b5176542214b91b31474ccb0c45e5f, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678575311823 2023-03-11 22:55:21,081 DEBUG [Listener at localhost.localdomain/41563] compactions.Compactor(207): Compacting 68b0e8c7014b4f3282f3b0d5c5e01b81, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678575313271 2023-03-11 22:55:21,081 DEBUG [Listener at localhost.localdomain/41563] compactions.Compactor(207): Compacting 8426df7308a5403ea1df7f36801672d4, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678575315081 2023-03-11 22:55:21,081 DEBUG [Listener at localhost.localdomain/41563] compactions.Compactor(207): Compacting 4ee2e92c7b8547768a6e8a457215c9fc, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-11 22:55:21,089 INFO [Listener at localhost.localdomain/41563] throttle.PressureAwareThroughputController(145): 84e7ece417189721cd2d8b7121fcfa8d#family2#compaction#155 average throughput is 0.51 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-11 22:55:21,165 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/84e7ece417189721cd2d8b7121fcfa8d/family1/c6d2a3c7524d4e14a414c4b5cb972b2d, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/84e7ece417189721cd2d8b7121fcfa8d/family1/251063ce4a214430908e42b3e09b6e89, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/84e7ece417189721cd2d8b7121fcfa8d/family1/951f369e0b5d49edbd84089035890c2f, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/84e7ece417189721cd2d8b7121fcfa8d/family1/6dabbba406a54a56b7256ce667ab1c20, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/84e7ece417189721cd2d8b7121fcfa8d/family1/163f52d6a39b4531b307396bc287e414] to archive 2023-03-11 22:55:21,166 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 22:55:21,168 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/84e7ece417189721cd2d8b7121fcfa8d/family1/c6d2a3c7524d4e14a414c4b5cb972b2d to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/ns/testMinorCompaction/84e7ece417189721cd2d8b7121fcfa8d/family1/c6d2a3c7524d4e14a414c4b5cb972b2d 2023-03-11 22:55:21,170 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/84e7ece417189721cd2d8b7121fcfa8d/family1/251063ce4a214430908e42b3e09b6e89 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/ns/testMinorCompaction/84e7ece417189721cd2d8b7121fcfa8d/family1/251063ce4a214430908e42b3e09b6e89 2023-03-11 22:55:21,172 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/84e7ece417189721cd2d8b7121fcfa8d/family1/951f369e0b5d49edbd84089035890c2f to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/ns/testMinorCompaction/84e7ece417189721cd2d8b7121fcfa8d/family1/951f369e0b5d49edbd84089035890c2f 2023-03-11 22:55:21,173 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/84e7ece417189721cd2d8b7121fcfa8d/family1/6dabbba406a54a56b7256ce667ab1c20 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/ns/testMinorCompaction/84e7ece417189721cd2d8b7121fcfa8d/family1/6dabbba406a54a56b7256ce667ab1c20 2023-03-11 22:55:21,174 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/84e7ece417189721cd2d8b7121fcfa8d/family1/163f52d6a39b4531b307396bc287e414 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/ns/testMinorCompaction/84e7ece417189721cd2d8b7121fcfa8d/family1/163f52d6a39b4531b307396bc287e414 2023-03-11 22:55:21,504 INFO [Listener at localhost.localdomain/41563] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202303111c10e1be67cc45808a4d7c322285fbfb_del 2023-03-11 22:55:21,504 INFO [Listener at localhost.localdomain/41563] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303111c10e1be67cc45808a4d7c322285fbfb_del to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c202303111c10e1be67cc45808a4d7c322285fbfb_del 2023-03-11 22:55:22,334 INFO [Listener at localhost.localdomain/41563] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2b16992b76434964befdfadd77c3a5bb 2023-03-11 22:55:22,336 DEBUG [Listener at localhost.localdomain/41563] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/84e7ece417189721cd2d8b7121fcfa8d/.tmp/family2/2b16992b76434964befdfadd77c3a5bb as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/84e7ece417189721cd2d8b7121fcfa8d/family2/2b16992b76434964befdfadd77c3a5bb 2023-03-11 22:55:22,341 INFO [Listener at localhost.localdomain/41563] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2b16992b76434964befdfadd77c3a5bb 2023-03-11 22:55:22,342 INFO [Listener at localhost.localdomain/41563] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 84e7ece417189721cd2d8b7121fcfa8d/family2 of 84e7ece417189721cd2d8b7121fcfa8d into 2b16992b76434964befdfadd77c3a5bb(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-11 22:55:22,342 DEBUG [Listener at localhost.localdomain/41563] regionserver.HRegion(2289): Compaction status journal for 84e7ece417189721cd2d8b7121fcfa8d: 2023-03-11 22:55:22,347 DEBUG [Listener at localhost.localdomain/41563] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-11 22:55:22,351 DEBUG [Listener at localhost.localdomain/41563] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-11 22:55:22,356 DEBUG [Listener at localhost.localdomain/41563] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-11 22:55:22,357 DEBUG [Listener at localhost.localdomain/41563] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-11 22:55:22,363 INFO [Listener at localhost.localdomain/41563] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-03-11 22:55:22,373 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/84e7ece417189721cd2d8b7121fcfa8d/family2/6e74c04fce9d49a299cf4aed735f59e2, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/84e7ece417189721cd2d8b7121fcfa8d/family2/50b5176542214b91b31474ccb0c45e5f, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/84e7ece417189721cd2d8b7121fcfa8d/family2/68b0e8c7014b4f3282f3b0d5c5e01b81, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/84e7ece417189721cd2d8b7121fcfa8d/family2/8426df7308a5403ea1df7f36801672d4, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/84e7ece417189721cd2d8b7121fcfa8d/family2/4ee2e92c7b8547768a6e8a457215c9fc] to archive 2023-03-11 22:55:22,374 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 22:55:22,376 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/84e7ece417189721cd2d8b7121fcfa8d/family2/6e74c04fce9d49a299cf4aed735f59e2 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/ns/testMinorCompaction/84e7ece417189721cd2d8b7121fcfa8d/family2/6e74c04fce9d49a299cf4aed735f59e2 2023-03-11 22:55:22,376 INFO [Listener at localhost.localdomain/41563] compactions.PartitionedMobCompactor(306): The compaction type is PART_FILES, the request has 3 del files, 3 selected files, and 0 irrelevant files table 'ns:testMinorCompaction' and column 'family1' 2023-03-11 22:55:22,377 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/84e7ece417189721cd2d8b7121fcfa8d/family2/50b5176542214b91b31474ccb0c45e5f to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/ns/testMinorCompaction/84e7ece417189721cd2d8b7121fcfa8d/family2/50b5176542214b91b31474ccb0c45e5f 2023-03-11 22:55:22,377 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/84e7ece417189721cd2d8b7121fcfa8d/family2/68b0e8c7014b4f3282f3b0d5c5e01b81 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/ns/testMinorCompaction/84e7ece417189721cd2d8b7121fcfa8d/family2/68b0e8c7014b4f3282f3b0d5c5e01b81 2023-03-11 22:55:22,378 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/84e7ece417189721cd2d8b7121fcfa8d/family2/8426df7308a5403ea1df7f36801672d4 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/ns/testMinorCompaction/84e7ece417189721cd2d8b7121fcfa8d/family2/8426df7308a5403ea1df7f36801672d4 2023-03-11 22:55:22,379 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/84e7ece417189721cd2d8b7121fcfa8d/family2/4ee2e92c7b8547768a6e8a457215c9fc to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/ns/testMinorCompaction/84e7ece417189721cd2d8b7121fcfa8d/family2/4ee2e92c7b8547768a6e8a457215c9fc 2023-03-11 22:55:22,380 INFO [Listener at localhost.localdomain/41563] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202303117dd9c5043c4c4a0da4e6b230ad8ab881_del 2023-03-11 22:55:22,382 INFO [Listener at localhost.localdomain/41563] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b2023031138f62ac5f4b44d169a8b3f5a86e5d41e_del 2023-03-11 22:55:22,384 INFO [Listener at localhost.localdomain/41563] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202303113edb88f8708445a48194d3e6a2972f92_del 2023-03-11 22:55:22,384 INFO [Listener at localhost.localdomain/41563] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='ns:testMinorCompaction' column='family1' 2023-03-11 22:55:22,385 DEBUG [Listener at localhost.localdomain/41563] zookeeper.ReadOnlyZKClient(139): Connect 0x61b3f1b5 to 127.0.0.1:51815 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-11 22:55:22,387 DEBUG [Listener at localhost.localdomain/41563] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4b4380d7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-11 22:55:22,388 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230311 for table='ns:testMinorCompaction' and column='family1' 2023-03-11 22:55:22,388 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230311 for table='ns:testMinorCompaction' and column='family1' 2023-03-11 22:55:22,388 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230311 for table='ns:testMinorCompaction' and column='family1' 2023-03-11 22:55:22,812 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230311cde73e67c6da4fd4abe3a71ffab40ae9 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230311cde73e67c6da4fd4abe3a71ffab40ae9 2023-03-11 22:55:22,813 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230311 table='ns:testMinorCompaction' column='family1' 2023-03-11 22:55:22,814 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202303116ae2c0f2d1e141249c09d18e1b25c841 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202303116ae2c0f2d1e141249c09d18e1b25c841 2023-03-11 22:55:22,814 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303116b05aa64016b4cc1a776309c46114f5d to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202303116b05aa64016b4cc1a776309c46114f5d 2023-03-11 22:55:22,815 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230311 table='ns:testMinorCompaction' column='family1' 2023-03-11 22:55:22,815 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230311 table='ns:testMinorCompaction' column='family1' 2023-03-11 22:55:22,826 DEBUG [MobFileCompactionChore-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-11 22:55:22,828 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:41580, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-11 22:55:22,834 DEBUG [MobFileCompactionChore-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-11 22:55:22,837 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:33780, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-11 22:55:22,856 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230311/family1/a93c3251f6524993988ce93608cce8ef first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x01] 2023-03-11 22:55:22,856 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230311/family1/8b8103bd044c4c77ad9060c7bbfe168e first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x01] 2023-03-11 22:55:22,857 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230311/family1/2ef10db8351240ee8af88e46c7dacaab first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x01] 2023-03-11 22:55:22,857 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=ns:testMinorCompaction,1,1678575308200.7087f753e6d78287d81e1391b6bb5914., hostname=jenkins-hbase20.apache.org,41843,1678575183185, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230311/family1/8b8103bd044c4c77ad9060c7bbfe168e}] 2023-03-11 22:55:22,857 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=ns:testMinorCompaction,,1678575308200.1d03ff70922c0981304d6eab43d86f2b., hostname=jenkins-hbase20.apache.org,41843,1678575183185, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230311/family1/a93c3251f6524993988ce93608cce8ef}] 2023-03-11 22:55:22,857 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=ns:testMinorCompaction,2,1678575308200.84e7ece417189721cd2d8b7121fcfa8d., hostname=jenkins-hbase20.apache.org,41843,1678575183185, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230311/family1/2ef10db8351240ee8af88e46c7dacaab}] 2023-03-11 22:55:22,865 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230311/family1/2ef10db8351240ee8af88e46c7dacaab for inclusion in 84e7ece417189721cd2d8b7121fcfa8d/family1 2023-03-11 22:55:22,865 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230311/family1/a93c3251f6524993988ce93608cce8ef for inclusion in 1d03ff70922c0981304d6eab43d86f2b/family1 2023-03-11 22:55:22,865 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41843] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230311/family1/8b8103bd044c4c77ad9060c7bbfe168e for inclusion in 7087f753e6d78287d81e1391b6bb5914/family1 2023-03-11 22:55:22,867 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41843] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x01 2023-03-11 22:55:22,867 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41843] regionserver.HStore(777): Region bounds: first=1 last=2 2023-03-11 22:55:22,867 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x01 2023-03-11 22:55:22,867 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.HStore(777): Region bounds: first=2 last= 2023-03-11 22:55:22,867 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41843] regionserver.HRegion(2446): Flush status journal for 7087f753e6d78287d81e1391b6bb5914: 2023-03-11 22:55:22,867 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.HRegion(2446): Flush status journal for 84e7ece417189721cd2d8b7121fcfa8d: 2023-03-11 22:55:22,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41843] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230311/family1/8b8103bd044c4c77ad9060c7bbfe168e to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__ns_testMinorCompaction__abnkir315toqcmruijafp313a8camn70ohoft5jaivfraqgonhplnr1grpshotpd/family1/8b8103bd044c4c77ad9060c7bbfe168e 2023-03-11 22:55:22,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x01 2023-03-11 22:55:22,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230311/family1/2ef10db8351240ee8af88e46c7dacaab to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__ns_testMinorCompaction__vnlev0tuq7u7qiq9a5goto5nvj6kr6l1thc4adc971gfh9k2sm3hklgvt45dfsml/family1/2ef10db8351240ee8af88e46c7dacaab 2023-03-11 22:55:22,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(777): Region bounds: first= last=1 2023-03-11 22:55:22,869 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HRegion(2446): Flush status journal for 1d03ff70922c0981304d6eab43d86f2b: 2023-03-11 22:55:22,869 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230311/family1/a93c3251f6524993988ce93608cce8ef to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__ns_testMinorCompaction__edinrserjjs5h0i11fvvku2kbj2vsr4bo6b82rsda56btcesmu8r2jnbaetf3cvh/family1/a93c3251f6524993988ce93608cce8ef 2023-03-11 22:55:22,870 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41843] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__ns_testMinorCompaction__abnkir315toqcmruijafp313a8camn70ohoft5jaivfraqgonhplnr1grpshotpd/family1/8b8103bd044c4c77ad9060c7bbfe168e as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/7087f753e6d78287d81e1391b6bb5914/family1/b1261039594e4805a4f94461402fd503_SeqId_28_ 2023-03-11 22:55:22,870 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__ns_testMinorCompaction__vnlev0tuq7u7qiq9a5goto5nvj6kr6l1thc4adc971gfh9k2sm3hklgvt45dfsml/family1/2ef10db8351240ee8af88e46c7dacaab as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/84e7ece417189721cd2d8b7121fcfa8d/family1/97ffd9b2ae6549c5904b3e864f81cc7b_SeqId_28_ 2023-03-11 22:55:22,870 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41843] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__ns_testMinorCompaction__abnkir315toqcmruijafp313a8camn70ohoft5jaivfraqgonhplnr1grpshotpd/family1/8b8103bd044c4c77ad9060c7bbfe168e into 7087f753e6d78287d81e1391b6bb5914/family1 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/7087f753e6d78287d81e1391b6bb5914/family1/b1261039594e4805a4f94461402fd503_SeqId_28_ - updating store file list. 2023-03-11 22:55:22,870 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__ns_testMinorCompaction__vnlev0tuq7u7qiq9a5goto5nvj6kr6l1thc4adc971gfh9k2sm3hklgvt45dfsml/family1/2ef10db8351240ee8af88e46c7dacaab into 84e7ece417189721cd2d8b7121fcfa8d/family1 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/84e7ece417189721cd2d8b7121fcfa8d/family1/97ffd9b2ae6549c5904b3e864f81cc7b_SeqId_28_ - updating store file list. 2023-03-11 22:55:22,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__ns_testMinorCompaction__edinrserjjs5h0i11fvvku2kbj2vsr4bo6b82rsda56btcesmu8r2jnbaetf3cvh/family1/a93c3251f6524993988ce93608cce8ef as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/1d03ff70922c0981304d6eab43d86f2b/family1/8ad3afa45e7f4162b83b2f8b26da9bbf_SeqId_28_ 2023-03-11 22:55:22,871 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__ns_testMinorCompaction__edinrserjjs5h0i11fvvku2kbj2vsr4bo6b82rsda56btcesmu8r2jnbaetf3cvh/family1/a93c3251f6524993988ce93608cce8ef into 1d03ff70922c0981304d6eab43d86f2b/family1 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/1d03ff70922c0981304d6eab43d86f2b/family1/8ad3afa45e7f4162b83b2f8b26da9bbf_SeqId_28_ - updating store file list. 2023-03-11 22:55:22,873 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/84e7ece417189721cd2d8b7121fcfa8d/family1/97ffd9b2ae6549c5904b3e864f81cc7b_SeqId_28_ into 84e7ece417189721cd2d8b7121fcfa8d/family1 2023-03-11 22:55:22,873 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41843] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/7087f753e6d78287d81e1391b6bb5914/family1/b1261039594e4805a4f94461402fd503_SeqId_28_ into 7087f753e6d78287d81e1391b6bb5914/family1 2023-03-11 22:55:22,873 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__ns_testMinorCompaction__vnlev0tuq7u7qiq9a5goto5nvj6kr6l1thc4adc971gfh9k2sm3hklgvt45dfsml/family1/2ef10db8351240ee8af88e46c7dacaab into 84e7ece417189721cd2d8b7121fcfa8d/family1 (new location: hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/84e7ece417189721cd2d8b7121fcfa8d/family1/97ffd9b2ae6549c5904b3e864f81cc7b_SeqId_28_) 2023-03-11 22:55:22,873 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41843] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__ns_testMinorCompaction__abnkir315toqcmruijafp313a8camn70ohoft5jaivfraqgonhplnr1grpshotpd/family1/8b8103bd044c4c77ad9060c7bbfe168e into 7087f753e6d78287d81e1391b6bb5914/family1 (new location: hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/7087f753e6d78287d81e1391b6bb5914/family1/b1261039594e4805a4f94461402fd503_SeqId_28_) 2023-03-11 22:55:22,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__ns_testMinorCompaction__vnlev0tuq7u7qiq9a5goto5nvj6kr6l1thc4adc971gfh9k2sm3hklgvt45dfsml/family1/2ef10db8351240ee8af88e46c7dacaab 2023-03-11 22:55:22,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41843] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__ns_testMinorCompaction__abnkir315toqcmruijafp313a8camn70ohoft5jaivfraqgonhplnr1grpshotpd/family1/8b8103bd044c4c77ad9060c7bbfe168e 2023-03-11 22:55:22,874 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/1d03ff70922c0981304d6eab43d86f2b/family1/8ad3afa45e7f4162b83b2f8b26da9bbf_SeqId_28_ into 1d03ff70922c0981304d6eab43d86f2b/family1 2023-03-11 22:55:22,874 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__ns_testMinorCompaction__edinrserjjs5h0i11fvvku2kbj2vsr4bo6b82rsda56btcesmu8r2jnbaetf3cvh/family1/a93c3251f6524993988ce93608cce8ef into 1d03ff70922c0981304d6eab43d86f2b/family1 (new location: hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/1d03ff70922c0981304d6eab43d86f2b/family1/8ad3afa45e7f4162b83b2f8b26da9bbf_SeqId_28_) 2023-03-11 22:55:22,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41843] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__ns_testMinorCompaction__edinrserjjs5h0i11fvvku2kbj2vsr4bo6b82rsda56btcesmu8r2jnbaetf3cvh/family1/a93c3251f6524993988ce93608cce8ef 2023-03-11 22:55:22,875 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230311 table='ns:testMinorCompaction' column='family1' 2023-03-11 22:55:22,875 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230311 table='ns:testMinorCompaction' column='family1' 2023-03-11 22:55:22,875 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230311 table='ns:testMinorCompaction' column='family1' 2023-03-11 22:55:22,875 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 22:55:22,875 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 22:55:22,875 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 22:55:22,876 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202303119570252d28dc4192aecbe41eb337fbcf to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202303119570252d28dc4192aecbe41eb337fbcf 2023-03-11 22:55:22,876 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-03-11 22:55:22,876 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230311bf4d6facf925452e87a6512ba0628771 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230311bf4d6facf925452e87a6512ba0628771 2023-03-11 22:55:22,876 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20230311fe5619cbb3d04a25aa0ec9ac02f94a9e to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20230311fe5619cbb3d04a25aa0ec9ac02f94a9e 2023-03-11 22:55:22,876 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230311' 2023-03-11 22:55:22,876 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-03-11 22:55:22,876 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-03-11 22:55:22,876 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230311' 2023-03-11 22:55:22,876 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230311' 2023-03-11 22:55:22,877 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230311 for table='ns:testMinorCompaction' and column='family1' 2023-03-11 22:55:22,877 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230311 for table='ns:testMinorCompaction' and column='family1' 2023-03-11 22:55:22,877 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230311 for table='ns:testMinorCompaction' and column='family1' 2023-03-11 22:55:22,877 INFO [Listener at localhost.localdomain/41563] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='ns:testMinorCompaction' column='family1' 2023-03-11 22:55:22,879 DEBUG [Listener at localhost.localdomain/41563] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-11 22:55:22,881 DEBUG [Listener at localhost.localdomain/41563] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-11 22:55:22,883 DEBUG [Listener at localhost.localdomain/41563] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-11 22:55:22,884 DEBUG [Listener at localhost.localdomain/41563] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-11 22:55:22,898 INFO [Listener at localhost.localdomain/41563] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompaction Thread=247 (was 284), OpenFileDescriptor=624 (was 762), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=185 (was 162) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=21442 (was 21441) - AvailableMemoryMB LEAK? - 2023-03-11 22:55:22,909 INFO [Listener at localhost.localdomain/41563] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompactionWithMonthlyPolicy Thread=247, OpenFileDescriptor=624, MaxFileDescriptor=60000, SystemLoadAverage=185, ProcessCount=168, AvailableMemoryMB=21441 2023-03-11 22:55:22,911 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testMinorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-03-11 22:55:22,912 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:22,913 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-03-11 22:55:22,913 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(697): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testMinorCompactionWithMonthlyPolicy" procId is: 112 2023-03-11 22:55:22,914 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-11 22:55:22,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-03-11 22:55:22,914 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/5cb27d102005ece125b41111cbb6d846 2023-03-11 22:55:22,915 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/5cb27d102005ece125b41111cbb6d846 empty. 2023-03-11 22:55:22,915 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/5cb27d102005ece125b41111cbb6d846 2023-03-11 22:55:22,915 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testMinorCompactionWithMonthlyPolicy regions 2023-03-11 22:55:23,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-03-11 22:55:23,216 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-03-11 22:55:23,322 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/.tabledesc/.tableinfo.0000000001 2023-03-11 22:55:23,323 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => 5cb27d102005ece125b41111cbb6d846, NAME => 'testMinorCompactionWithMonthlyPolicy,,1678575322911.5cb27d102005ece125b41111cbb6d846.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMinorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}, regionDir=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/.tmp 2023-03-11 22:55:23,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-03-11 22:55:23,731 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithMonthlyPolicy,,1678575322911.5cb27d102005ece125b41111cbb6d846.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-11 22:55:23,731 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1604): Closing 5cb27d102005ece125b41111cbb6d846, disabling compactions & flushes 2023-03-11 22:55:23,731 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithMonthlyPolicy,,1678575322911.5cb27d102005ece125b41111cbb6d846. 2023-03-11 22:55:23,731 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithMonthlyPolicy,,1678575322911.5cb27d102005ece125b41111cbb6d846. 2023-03-11 22:55:23,731 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithMonthlyPolicy,,1678575322911.5cb27d102005ece125b41111cbb6d846. after waiting 0 ms 2023-03-11 22:55:23,731 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithMonthlyPolicy,,1678575322911.5cb27d102005ece125b41111cbb6d846. 2023-03-11 22:55:23,732 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1838): Closed testMinorCompactionWithMonthlyPolicy,,1678575322911.5cb27d102005ece125b41111cbb6d846. 2023-03-11 22:55:23,732 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for 5cb27d102005ece125b41111cbb6d846: 2023-03-11 22:55:23,736 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-03-11 22:55:23,738 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMinorCompactionWithMonthlyPolicy,,1678575322911.5cb27d102005ece125b41111cbb6d846.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1678575323738"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678575323738"}]},"ts":"1678575323738"} 2023-03-11 22:55:23,740 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-03-11 22:55:23,742 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-11 22:55:23,742 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678575323742"}]},"ts":"1678575323742"} 2023-03-11 22:55:23,744 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithMonthlyPolicy, state=ENABLING in hbase:meta 2023-03-11 22:55:23,746 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=5cb27d102005ece125b41111cbb6d846, ASSIGN}] 2023-03-11 22:55:23,747 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=5cb27d102005ece125b41111cbb6d846, ASSIGN 2023-03-11 22:55:23,747 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=5cb27d102005ece125b41111cbb6d846, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,41843,1678575183185; forceNewPlan=false, retain=false 2023-03-11 22:55:23,899 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=113 updating hbase:meta row=5cb27d102005ece125b41111cbb6d846, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:23,899 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMinorCompactionWithMonthlyPolicy,,1678575322911.5cb27d102005ece125b41111cbb6d846.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1678575323899"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1678575323899"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678575323899"}]},"ts":"1678575323899"} 2023-03-11 22:55:23,903 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=114, ppid=113, state=RUNNABLE; OpenRegionProcedure 5cb27d102005ece125b41111cbb6d846, server=jenkins-hbase20.apache.org,41843,1678575183185}] 2023-03-11 22:55:24,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-03-11 22:55:24,061 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testMinorCompactionWithMonthlyPolicy,,1678575322911.5cb27d102005ece125b41111cbb6d846. 2023-03-11 22:55:24,062 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5cb27d102005ece125b41111cbb6d846, NAME => 'testMinorCompactionWithMonthlyPolicy,,1678575322911.5cb27d102005ece125b41111cbb6d846.', STARTKEY => '', ENDKEY => ''} 2023-03-11 22:55:24,062 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompactionWithMonthlyPolicy 5cb27d102005ece125b41111cbb6d846 2023-03-11 22:55:24,062 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithMonthlyPolicy,,1678575322911.5cb27d102005ece125b41111cbb6d846.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-11 22:55:24,063 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 5cb27d102005ece125b41111cbb6d846 2023-03-11 22:55:24,063 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 5cb27d102005ece125b41111cbb6d846 2023-03-11 22:55:24,066 INFO [StoreOpener-5cb27d102005ece125b41111cbb6d846-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 5cb27d102005ece125b41111cbb6d846 2023-03-11 22:55:24,068 DEBUG [StoreOpener-5cb27d102005ece125b41111cbb6d846-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithMonthlyPolicy/5cb27d102005ece125b41111cbb6d846/family1 2023-03-11 22:55:24,068 DEBUG [StoreOpener-5cb27d102005ece125b41111cbb6d846-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithMonthlyPolicy/5cb27d102005ece125b41111cbb6d846/family1 2023-03-11 22:55:24,069 INFO [StoreOpener-5cb27d102005ece125b41111cbb6d846-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5cb27d102005ece125b41111cbb6d846 columnFamilyName family1 2023-03-11 22:55:24,070 INFO [StoreOpener-5cb27d102005ece125b41111cbb6d846-1] regionserver.HStore(310): Store=5cb27d102005ece125b41111cbb6d846/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-11 22:55:24,071 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithMonthlyPolicy/5cb27d102005ece125b41111cbb6d846 2023-03-11 22:55:24,072 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithMonthlyPolicy/5cb27d102005ece125b41111cbb6d846 2023-03-11 22:55:24,074 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 5cb27d102005ece125b41111cbb6d846 2023-03-11 22:55:24,076 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithMonthlyPolicy/5cb27d102005ece125b41111cbb6d846/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-11 22:55:24,077 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 5cb27d102005ece125b41111cbb6d846; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60720730, jitterRate=-0.0951906144618988}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-11 22:55:24,077 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 5cb27d102005ece125b41111cbb6d846: 2023-03-11 22:55:24,077 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMinorCompactionWithMonthlyPolicy,,1678575322911.5cb27d102005ece125b41111cbb6d846., pid=114, masterSystemTime=1678575324055 2023-03-11 22:55:24,079 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMinorCompactionWithMonthlyPolicy,,1678575322911.5cb27d102005ece125b41111cbb6d846. 2023-03-11 22:55:24,079 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testMinorCompactionWithMonthlyPolicy,,1678575322911.5cb27d102005ece125b41111cbb6d846. 2023-03-11 22:55:24,079 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=113 updating hbase:meta row=5cb27d102005ece125b41111cbb6d846, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:24,079 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMinorCompactionWithMonthlyPolicy,,1678575322911.5cb27d102005ece125b41111cbb6d846.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1678575324079"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1678575324079"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678575324079"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678575324079"}]},"ts":"1678575324079"} 2023-03-11 22:55:24,082 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=114, resume processing ppid=113 2023-03-11 22:55:24,082 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=114, ppid=113, state=SUCCESS; OpenRegionProcedure 5cb27d102005ece125b41111cbb6d846, server=jenkins-hbase20.apache.org,41843,1678575183185 in 177 msec 2023-03-11 22:55:24,084 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=113, resume processing ppid=112 2023-03-11 22:55:24,084 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=113, ppid=112, state=SUCCESS; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=5cb27d102005ece125b41111cbb6d846, ASSIGN in 337 msec 2023-03-11 22:55:24,084 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-11 22:55:24,084 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678575324084"}]},"ts":"1678575324084"} 2023-03-11 22:55:24,085 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithMonthlyPolicy, state=ENABLED in hbase:meta 2023-03-11 22:55:24,088 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-03-11 22:55:24,089 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy in 1.1770 sec 2023-03-11 22:55:25,023 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-03-11 22:55:25,023 INFO [Listener at localhost.localdomain/41563] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMinorCompactionWithMonthlyPolicy, procId: 112 completed 2023-03-11 22:55:25,046 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-11 22:55:25,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:25,047 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-03-11 22:55:25,047 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:55:25,047 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-11 22:55:25,047 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-11 22:55:25,048 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:25,048 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:25,048 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:55:25,048 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:25,048 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:55:25,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:55:25,048 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:25,049 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 22:55:25,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:25,049 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:25,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 22:55:25,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:25,049 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:25,049 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:25,050 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-11 22:55:25,050 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:55:25,050 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-11 22:55:25,050 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 22:55:25,051 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 22:55:25,051 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1678575322911.5cb27d102005ece125b41111cbb6d846. 2023-03-11 22:55:25,051 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1678575322911.5cb27d102005ece125b41111cbb6d846. started... 2023-03-11 22:55:25,051 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 5cb27d102005ece125b41111cbb6d846 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-03-11 22:55:25,478 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130d3c537bfb3a74c71a03945e01733976c to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151130d3c537bfb3a74c71a03945e01733976c 2023-03-11 22:55:25,886 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithMonthlyPolicy/5cb27d102005ece125b41111cbb6d846/.tmp/family1/12a72e224cfa4d81927034f8c982ee1e 2023-03-11 22:55:25,897 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithMonthlyPolicy/5cb27d102005ece125b41111cbb6d846/.tmp/family1/12a72e224cfa4d81927034f8c982ee1e as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithMonthlyPolicy/5cb27d102005ece125b41111cbb6d846/family1/12a72e224cfa4d81927034f8c982ee1e 2023-03-11 22:55:25,900 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithMonthlyPolicy/5cb27d102005ece125b41111cbb6d846/family1/12a72e224cfa4d81927034f8c982ee1e, entries=1000, sequenceid=5, filesize=166.0 K 2023-03-11 22:55:25,901 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 5cb27d102005ece125b41111cbb6d846 in 850ms, sequenceid=5, compaction requested=false 2023-03-11 22:55:25,901 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMinorCompactionWithMonthlyPolicy' 2023-03-11 22:55:25,902 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 5cb27d102005ece125b41111cbb6d846: 2023-03-11 22:55:25,902 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1678575322911.5cb27d102005ece125b41111cbb6d846. 2023-03-11 22:55:25,902 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 22:55:25,902 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 22:55:25,902 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:25,902 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-03-11 22:55:25,902 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-03-11 22:55:25,903 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:25,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:25,903 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:25,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:55:25,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:55:25,903 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:25,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:55:25,903 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 22:55:25,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:55:25,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:25,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:25,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:55:25,905 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-03-11 22:55:25,905 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2300b719[Count = 0] remaining members to acquire global barrier 2023-03-11 22:55:25,905 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-11 22:55:25,905 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:25,905 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:25,906 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:25,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:25,906 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-11 22:55:25,906 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-03-11 22:55:25,906 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,41843,1678575183185' in zk 2023-03-11 22:55:25,906 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:25,906 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 22:55:25,906 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-11 22:55:25,906 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:55:25,906 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:25,906 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-03-11 22:55:25,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:25,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:55:25,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:55:25,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:55:25,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:55:25,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:25,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:25,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:55:25,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:25,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:25,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,41843,1678575183185': 2023-03-11 22:55:25,909 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-11 22:55:25,909 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-03-11 22:55:25,909 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 22:55:25,909 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 22:55:25,909 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:25,909 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 22:55:25,910 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:25,910 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:25,910 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:25,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:25,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:55:25,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:55:25,910 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:55:25,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:25,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:55:25,911 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:25,911 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:55:25,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:55:25,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:25,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:25,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:55:25,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:25,912 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:25,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:25,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:55:25,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:25,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:25,914 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:25,914 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:55:25,914 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:25,914 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:55:25,914 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-11 22:55:25,914 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-03-11 22:55:25,914 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 22:55:25,914 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:25,914 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:25,914 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:25,914 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:25,914 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:25,914 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:55:25,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:55:25,914 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:55:25,914 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-11 22:55:25,915 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 22:55:25,915 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:55:25,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:55:26,015 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 22:55:26,017 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 22:55:26,028 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-11 22:55:26,030 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-11 22:55:26,030 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:26,030 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-03-11 22:55:26,030 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:55:26,030 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-11 22:55:26,030 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-11 22:55:26,031 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:26,031 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:26,032 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:26,032 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:55:26,032 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:55:26,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:55:26,032 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:26,032 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 22:55:26,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:26,033 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:26,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 22:55:26,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:26,033 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:26,034 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-03-11 22:55:26,034 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:26,034 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-11 22:55:26,034 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:55:26,034 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-11 22:55:26,034 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 22:55:26,034 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 22:55:26,034 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1678575322911.5cb27d102005ece125b41111cbb6d846. 2023-03-11 22:55:26,034 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1678575322911.5cb27d102005ece125b41111cbb6d846. started... 2023-03-11 22:55:26,034 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 5cb27d102005ece125b41111cbb6d846 1/1 column families, dataSize=74 B heapSize=408 B 2023-03-11 22:55:26,452 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511287a3b1f1496b44ba298dbf21608cd9498 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511287a3b1f1496b44ba298dbf21608cd9498 2023-03-11 22:55:26,860 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithMonthlyPolicy/5cb27d102005ece125b41111cbb6d846/.tmp/family1/158eea336522437b8a33fb4d39cb27bc 2023-03-11 22:55:26,873 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithMonthlyPolicy/5cb27d102005ece125b41111cbb6d846/.tmp/family1/158eea336522437b8a33fb4d39cb27bc as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithMonthlyPolicy/5cb27d102005ece125b41111cbb6d846/family1/158eea336522437b8a33fb4d39cb27bc 2023-03-11 22:55:26,880 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithMonthlyPolicy/5cb27d102005ece125b41111cbb6d846/family1/158eea336522437b8a33fb4d39cb27bc, entries=1, sequenceid=9, filesize=5.0 K 2023-03-11 22:55:26,882 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 5cb27d102005ece125b41111cbb6d846 in 848ms, sequenceid=9, compaction requested=false 2023-03-11 22:55:26,882 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 5cb27d102005ece125b41111cbb6d846: 2023-03-11 22:55:26,882 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1678575322911.5cb27d102005ece125b41111cbb6d846. 2023-03-11 22:55:26,882 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 22:55:26,882 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 22:55:26,882 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:26,882 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-03-11 22:55:26,882 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-03-11 22:55:26,884 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:26,884 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:26,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:26,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:55:26,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:55:26,884 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:26,884 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 22:55:26,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:55:26,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:55:26,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:26,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:26,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:55:26,886 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-03-11 22:55:26,887 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@294f6a3a[Count = 0] remaining members to acquire global barrier 2023-03-11 22:55:26,887 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-11 22:55:26,887 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:26,887 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:26,888 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:26,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:26,888 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-11 22:55:26,888 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-03-11 22:55:26,888 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,41843,1678575183185' in zk 2023-03-11 22:55:26,888 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:26,888 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 22:55:26,889 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-11 22:55:26,889 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:55:26,889 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:26,889 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-03-11 22:55:26,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:26,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:55:26,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:55:26,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:55:26,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:55:26,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:26,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:26,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:55:26,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:26,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:26,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,41843,1678575183185': 2023-03-11 22:55:26,893 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-11 22:55:26,893 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-03-11 22:55:26,893 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 22:55:26,893 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 22:55:26,893 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:26,893 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 22:55:26,895 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:26,895 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:26,895 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:55:26,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:26,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:55:26,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:55:26,895 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:26,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:26,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:55:26,896 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:26,896 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:55:26,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:55:26,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:26,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:26,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:55:26,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:26,898 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:26,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:26,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:55:26,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:26,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:26,902 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:26,902 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:55:26,902 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:55:26,902 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:55:26,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:55:26,902 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:26,902 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-11 22:55:26,902 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-03-11 22:55:26,903 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 22:55:26,902 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:55:26,903 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:55:26,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:55:26,903 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:26,903 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-11 22:55:26,903 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:26,904 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 22:55:26,904 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:26,904 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:26,904 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:27,004 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 22:55:27,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 22:55:27,014 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-11 22:55:27,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-11 22:55:27,017 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:27,017 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-03-11 22:55:27,017 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:55:27,017 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-11 22:55:27,017 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-11 22:55:27,018 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:27,018 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:27,019 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:27,019 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:55:27,019 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:55:27,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:55:27,020 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:27,020 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 22:55:27,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:27,021 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:27,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 22:55:27,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:27,022 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:27,022 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-03-11 22:55:27,022 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:27,022 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-11 22:55:27,022 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:55:27,022 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-11 22:55:27,022 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 22:55:27,023 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 22:55:27,023 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1678575322911.5cb27d102005ece125b41111cbb6d846. 2023-03-11 22:55:27,023 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1678575322911.5cb27d102005ece125b41111cbb6d846. started... 2023-03-11 22:55:27,023 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 5cb27d102005ece125b41111cbb6d846 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-11 22:55:27,445 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201feda42af062542f18cd70a5ab0a43428 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151201feda42af062542f18cd70a5ab0a43428 2023-03-11 22:55:27,854 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithMonthlyPolicy/5cb27d102005ece125b41111cbb6d846/.tmp/family1/a7ab786aa5e24a1b80775d9d7b0dd965 2023-03-11 22:55:27,863 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithMonthlyPolicy/5cb27d102005ece125b41111cbb6d846/.tmp/family1/a7ab786aa5e24a1b80775d9d7b0dd965 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithMonthlyPolicy/5cb27d102005ece125b41111cbb6d846/family1/a7ab786aa5e24a1b80775d9d7b0dd965 2023-03-11 22:55:27,870 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithMonthlyPolicy/5cb27d102005ece125b41111cbb6d846/family1/a7ab786aa5e24a1b80775d9d7b0dd965, entries=1, sequenceid=13, filesize=4.9 K 2023-03-11 22:55:27,871 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 5cb27d102005ece125b41111cbb6d846 in 848ms, sequenceid=13, compaction requested=true 2023-03-11 22:55:27,872 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 5cb27d102005ece125b41111cbb6d846: 2023-03-11 22:55:27,872 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1678575322911.5cb27d102005ece125b41111cbb6d846. 2023-03-11 22:55:27,872 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 22:55:27,872 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 22:55:27,872 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:27,873 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-03-11 22:55:27,873 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-03-11 22:55:27,874 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:27,874 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:27,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:27,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:55:27,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:55:27,874 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:27,874 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 22:55:27,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:55:27,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:55:27,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:27,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:27,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:55:27,876 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-03-11 22:55:27,876 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@189f75e7[Count = 0] remaining members to acquire global barrier 2023-03-11 22:55:27,876 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-11 22:55:27,876 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:27,877 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:27,877 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:27,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:27,877 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-11 22:55:27,877 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-03-11 22:55:27,877 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,41843,1678575183185' in zk 2023-03-11 22:55:27,877 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:27,877 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 22:55:27,878 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:27,878 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-11 22:55:27,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:27,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:55:27,878 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:55:27,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:55:27,878 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-03-11 22:55:27,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:55:27,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:55:27,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:27,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:27,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:55:27,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:27,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:27,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,41843,1678575183185': 2023-03-11 22:55:27,880 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-11 22:55:27,880 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-03-11 22:55:27,880 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 22:55:27,880 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 22:55:27,880 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:27,880 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 22:55:27,881 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:27,881 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:27,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:27,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:55:27,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:55:27,881 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:27,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:27,881 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:55:27,881 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:27,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:55:27,881 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:55:27,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:55:27,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:27,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:27,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:55:27,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:27,882 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:27,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:27,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:55:27,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:27,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:27,883 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:27,883 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:55:27,883 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:27,883 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-03-11 22:55:27,883 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 22:55:27,883 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:27,883 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:55:27,883 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:55:27,884 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-11 22:55:27,883 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:55:27,884 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-11 22:55:27,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:55:27,884 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:27,884 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 22:55:27,884 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:27,884 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:27,884 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:27,884 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:55:27,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:55:27,984 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 22:55:27,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 22:55:27,991 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-11 22:55:27,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-11 22:55:27,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:27,994 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-03-11 22:55:27,994 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:55:27,994 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-11 22:55:27,994 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-11 22:55:27,995 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:27,995 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:27,996 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:55:27,996 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:27,996 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:55:27,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:55:27,996 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:27,996 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 22:55:27,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:27,997 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:27,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 22:55:27,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:27,997 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:27,997 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-03-11 22:55:27,997 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:27,997 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-11 22:55:27,997 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:55:27,997 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-11 22:55:27,998 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 22:55:27,998 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 22:55:27,998 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1678575322911.5cb27d102005ece125b41111cbb6d846. 2023-03-11 22:55:27,998 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1678575322911.5cb27d102005ece125b41111cbb6d846. started... 2023-03-11 22:55:27,998 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 5cb27d102005ece125b41111cbb6d846 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-11 22:55:28,420 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120547e82381d6294091bedf5d41b37c384a to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015120547e82381d6294091bedf5d41b37c384a 2023-03-11 22:55:28,828 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithMonthlyPolicy/5cb27d102005ece125b41111cbb6d846/.tmp/family1/fff1f47cc9134ac49920119eff6b9cf9 2023-03-11 22:55:28,831 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithMonthlyPolicy/5cb27d102005ece125b41111cbb6d846/.tmp/family1/fff1f47cc9134ac49920119eff6b9cf9 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithMonthlyPolicy/5cb27d102005ece125b41111cbb6d846/family1/fff1f47cc9134ac49920119eff6b9cf9 2023-03-11 22:55:28,834 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithMonthlyPolicy/5cb27d102005ece125b41111cbb6d846/family1/fff1f47cc9134ac49920119eff6b9cf9, entries=1, sequenceid=17, filesize=4.9 K 2023-03-11 22:55:28,835 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 5cb27d102005ece125b41111cbb6d846 in 837ms, sequenceid=17, compaction requested=true 2023-03-11 22:55:28,835 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 5cb27d102005ece125b41111cbb6d846: 2023-03-11 22:55:28,835 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1678575322911.5cb27d102005ece125b41111cbb6d846. 2023-03-11 22:55:28,835 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 22:55:28,835 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 22:55:28,835 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:28,835 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-03-11 22:55:28,835 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-03-11 22:55:28,836 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:28,836 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:28,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:28,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:55:28,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:55:28,836 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:28,837 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 22:55:28,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:55:28,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:55:28,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:28,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:28,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:55:28,838 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-03-11 22:55:28,838 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7778bf6f[Count = 0] remaining members to acquire global barrier 2023-03-11 22:55:28,838 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-11 22:55:28,838 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:28,838 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:28,838 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:28,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:28,838 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-11 22:55:28,838 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:28,838 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 22:55:28,838 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-03-11 22:55:28,838 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,41843,1678575183185' in zk 2023-03-11 22:55:28,839 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-11 22:55:28,839 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:55:28,839 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:28,839 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-03-11 22:55:28,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:28,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:55:28,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:55:28,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:55:28,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:55:28,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:28,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:28,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:55:28,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:28,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:28,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,41843,1678575183185': 2023-03-11 22:55:28,841 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-11 22:55:28,841 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-03-11 22:55:28,841 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 22:55:28,841 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 22:55:28,841 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:28,841 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 22:55:28,842 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:28,842 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:28,842 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:28,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:28,842 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:55:28,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:28,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:55:28,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:55:28,842 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:55:28,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:55:28,842 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:28,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:55:28,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:28,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:28,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:55:28,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:28,843 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:28,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:28,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:55:28,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:28,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:28,844 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:28,844 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:55:28,844 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:28,844 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:55:28,844 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-03-11 22:55:28,844 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 22:55:28,844 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:55:28,844 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-11 22:55:28,844 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:55:28,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:55:28,844 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:28,844 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-11 22:55:28,845 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 22:55:28,844 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:28,845 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:55:28,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:55:28,845 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:28,845 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:28,845 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:28,945 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 22:55:28,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 22:55:28,949 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-11 22:55:28,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-11 22:55:28,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:28,950 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-03-11 22:55:28,950 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:55:28,950 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-11 22:55:28,951 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-11 22:55:28,951 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:28,951 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:28,952 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:55:28,952 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:55:28,952 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:28,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:55:28,952 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:28,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:28,952 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 22:55:28,953 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:28,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 22:55:28,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:28,953 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:28,953 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-03-11 22:55:28,953 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:28,953 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-11 22:55:28,954 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:55:28,954 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-11 22:55:28,955 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 22:55:28,955 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 22:55:28,955 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1678575322911.5cb27d102005ece125b41111cbb6d846. 2023-03-11 22:55:28,955 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1678575322911.5cb27d102005ece125b41111cbb6d846. started... 2023-03-11 22:55:28,956 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 5cb27d102005ece125b41111cbb6d846 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-11 22:55:29,366 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512285cdeb2784cc54fab94b8421b01399703 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512285cdeb2784cc54fab94b8421b01399703 2023-03-11 22:55:29,599 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-11 22:55:29,771 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithMonthlyPolicy/5cb27d102005ece125b41111cbb6d846/.tmp/family1/2060eb64831f4a98b7a132bd80cb0a6f 2023-03-11 22:55:29,775 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithMonthlyPolicy/5cb27d102005ece125b41111cbb6d846/.tmp/family1/2060eb64831f4a98b7a132bd80cb0a6f as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithMonthlyPolicy/5cb27d102005ece125b41111cbb6d846/family1/2060eb64831f4a98b7a132bd80cb0a6f 2023-03-11 22:55:29,778 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithMonthlyPolicy/5cb27d102005ece125b41111cbb6d846/family1/2060eb64831f4a98b7a132bd80cb0a6f, entries=1, sequenceid=21, filesize=4.9 K 2023-03-11 22:55:29,778 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 5cb27d102005ece125b41111cbb6d846 in 822ms, sequenceid=21, compaction requested=true 2023-03-11 22:55:29,779 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 5cb27d102005ece125b41111cbb6d846: 2023-03-11 22:55:29,779 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1678575322911.5cb27d102005ece125b41111cbb6d846. 2023-03-11 22:55:29,779 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 22:55:29,779 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 22:55:29,779 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:29,779 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-03-11 22:55:29,779 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-03-11 22:55:29,780 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:29,780 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:29,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:29,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:55:29,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:55:29,780 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:29,780 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 22:55:29,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:55:29,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:55:29,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:29,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:29,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:55:29,781 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-03-11 22:55:29,781 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@51e666e6[Count = 0] remaining members to acquire global barrier 2023-03-11 22:55:29,781 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-11 22:55:29,781 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:29,781 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:29,781 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:29,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:29,781 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-11 22:55:29,781 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-03-11 22:55:29,781 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,41843,1678575183185' in zk 2023-03-11 22:55:29,781 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:29,781 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 22:55:29,782 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-11 22:55:29,782 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:29,782 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:55:29,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:29,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:55:29,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:55:29,782 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-03-11 22:55:29,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:55:29,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:55:29,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:29,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:29,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:55:29,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:29,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:29,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,41843,1678575183185': 2023-03-11 22:55:29,784 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-11 22:55:29,784 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-03-11 22:55:29,784 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 22:55:29,784 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 22:55:29,784 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:29,784 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 22:55:29,786 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:29,786 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:29,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:29,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:55:29,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:55:29,786 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:29,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:29,786 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:55:29,786 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:29,786 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:55:29,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:55:29,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:55:29,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:29,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:29,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:55:29,787 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:29,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:29,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:29,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:55:29,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:29,788 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:29,788 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:55:29,788 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:29,788 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:55:29,788 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:55:29,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:55:29,788 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:55:29,788 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-03-11 22:55:29,788 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 22:55:29,788 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:29,788 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-11 22:55:29,788 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:29,788 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:29,788 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:29,788 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:29,788 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-11 22:55:29,788 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:55:29,788 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 22:55:29,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:55:29,889 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 22:55:29,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 22:55:29,893 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-11 22:55:29,894 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-11 22:55:29,894 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:29,894 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-03-11 22:55:29,894 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:55:29,894 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-11 22:55:29,894 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-11 22:55:29,894 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:29,894 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:29,895 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:29,895 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:55:29,895 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:55:29,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:55:29,895 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:29,895 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 22:55:29,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:29,896 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:29,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 22:55:29,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:29,896 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:29,897 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-03-11 22:55:29,897 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:29,897 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-11 22:55:29,897 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:55:29,897 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-11 22:55:29,897 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 22:55:29,897 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 22:55:29,897 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1678575322911.5cb27d102005ece125b41111cbb6d846. 2023-03-11 22:55:29,897 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1678575322911.5cb27d102005ece125b41111cbb6d846. started... 2023-03-11 22:55:29,897 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 5cb27d102005ece125b41111cbb6d846 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-11 22:55:30,307 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231d0bc50941eb54ec2994a09ec2cbd9197 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231d0bc50941eb54ec2994a09ec2cbd9197 2023-03-11 22:55:30,716 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithMonthlyPolicy/5cb27d102005ece125b41111cbb6d846/.tmp/family1/531d5b59802c407ea96b016d8af61b88 2023-03-11 22:55:30,720 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithMonthlyPolicy/5cb27d102005ece125b41111cbb6d846/.tmp/family1/531d5b59802c407ea96b016d8af61b88 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithMonthlyPolicy/5cb27d102005ece125b41111cbb6d846/family1/531d5b59802c407ea96b016d8af61b88 2023-03-11 22:55:30,723 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithMonthlyPolicy/5cb27d102005ece125b41111cbb6d846/family1/531d5b59802c407ea96b016d8af61b88, entries=1, sequenceid=25, filesize=4.9 K 2023-03-11 22:55:30,723 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 5cb27d102005ece125b41111cbb6d846 in 826ms, sequenceid=25, compaction requested=true 2023-03-11 22:55:30,724 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 5cb27d102005ece125b41111cbb6d846: 2023-03-11 22:55:30,724 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1678575322911.5cb27d102005ece125b41111cbb6d846. 2023-03-11 22:55:30,724 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 22:55:30,724 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 22:55:30,724 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:30,724 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-03-11 22:55:30,724 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-03-11 22:55:30,725 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:30,725 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:30,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:30,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:55:30,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:55:30,725 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:30,725 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 22:55:30,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:55:30,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:55:30,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:30,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:30,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:55:30,726 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-03-11 22:55:30,726 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@32ad85a[Count = 0] remaining members to acquire global barrier 2023-03-11 22:55:30,726 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-11 22:55:30,727 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:30,727 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:30,727 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:30,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:30,727 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-11 22:55:30,727 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-03-11 22:55:30,727 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,41843,1678575183185' in zk 2023-03-11 22:55:30,727 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:30,728 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 22:55:30,728 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-11 22:55:30,728 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:55:30,728 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:30,728 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-03-11 22:55:30,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:30,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:55:30,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:55:30,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:55:30,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:55:30,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:30,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:30,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:55:30,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:30,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:30,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,41843,1678575183185': 2023-03-11 22:55:30,730 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-11 22:55:30,730 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-03-11 22:55:30,730 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 22:55:30,730 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 22:55:30,730 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:30,730 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 22:55:30,731 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:30,731 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:30,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:30,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:55:30,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:55:30,731 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:30,731 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:55:30,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:30,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:55:30,731 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:30,731 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:55:30,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:55:30,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:30,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:30,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:55:30,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:30,732 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:30,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:30,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:55:30,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:30,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:30,734 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:30,734 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:55:30,734 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:30,734 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:55:30,734 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-03-11 22:55:30,734 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 22:55:30,734 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:55:30,734 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-11 22:55:30,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:55:30,734 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:55:30,734 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:30,734 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-11 22:55:30,734 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 22:55:30,734 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:30,734 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:55:30,734 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:30,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:55:30,734 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:30,734 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:30,834 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 22:55:30,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 22:55:30,838 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-11 22:55:30,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-11 22:55:30,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:30,845 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-03-11 22:55:30,845 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:55:30,845 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-11 22:55:30,845 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-11 22:55:30,845 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:30,845 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:30,846 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:55:30,846 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:55:30,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:55:30,846 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:30,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:30,846 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:30,846 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 22:55:30,847 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:30,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 22:55:30,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:30,847 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:30,847 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-03-11 22:55:30,847 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:30,847 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-11 22:55:30,847 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:55:30,847 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-11 22:55:30,847 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 22:55:30,847 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 22:55:30,847 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1678575322911.5cb27d102005ece125b41111cbb6d846. 2023-03-11 22:55:30,847 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1678575322911.5cb27d102005ece125b41111cbb6d846. started... 2023-03-11 22:55:30,847 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 5cb27d102005ece125b41111cbb6d846 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-11 22:55:30,861 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010141ebb728ae2a4671bccb2092f3599db1 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2016010141ebb728ae2a4671bccb2092f3599db1 2023-03-11 22:55:31,271 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithMonthlyPolicy/5cb27d102005ece125b41111cbb6d846/.tmp/family1/656777e2da3d4c55894a2eb00d830150 2023-03-11 22:55:31,275 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithMonthlyPolicy/5cb27d102005ece125b41111cbb6d846/.tmp/family1/656777e2da3d4c55894a2eb00d830150 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithMonthlyPolicy/5cb27d102005ece125b41111cbb6d846/family1/656777e2da3d4c55894a2eb00d830150 2023-03-11 22:55:31,278 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithMonthlyPolicy/5cb27d102005ece125b41111cbb6d846/family1/656777e2da3d4c55894a2eb00d830150, entries=1, sequenceid=29, filesize=4.9 K 2023-03-11 22:55:31,279 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 5cb27d102005ece125b41111cbb6d846 in 432ms, sequenceid=29, compaction requested=true 2023-03-11 22:55:31,279 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 5cb27d102005ece125b41111cbb6d846: 2023-03-11 22:55:31,279 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1678575322911.5cb27d102005ece125b41111cbb6d846. 2023-03-11 22:55:31,279 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 22:55:31,279 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 22:55:31,279 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:31,279 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-03-11 22:55:31,279 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-03-11 22:55:31,280 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:31,280 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:31,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:31,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:55:31,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:55:31,281 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:31,281 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 22:55:31,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:55:31,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:55:31,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:31,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:31,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:55:31,282 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-03-11 22:55:31,282 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-11 22:55:31,282 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@60f9a595[Count = 0] remaining members to acquire global barrier 2023-03-11 22:55:31,282 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:31,282 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:31,282 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:31,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:31,282 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-11 22:55:31,283 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-03-11 22:55:31,283 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,41843,1678575183185' in zk 2023-03-11 22:55:31,283 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:31,283 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 22:55:31,283 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-11 22:55:31,283 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:31,283 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:55:31,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:31,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:55:31,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:55:31,283 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-03-11 22:55:31,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:55:31,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:55:31,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:31,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:31,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:55:31,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:31,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:31,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,41843,1678575183185': 2023-03-11 22:55:31,285 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-11 22:55:31,285 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-03-11 22:55:31,285 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 22:55:31,285 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 22:55:31,285 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:31,285 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 22:55:31,286 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:31,286 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:31,286 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:31,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:31,286 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:55:31,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:31,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:55:31,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:55:31,286 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:55:31,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:55:31,286 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:31,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:55:31,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:31,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:31,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:55:31,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:31,287 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:31,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:31,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:55:31,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:31,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:31,288 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:31,288 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:31,288 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:55:31,288 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:31,288 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:55:31,288 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:55:31,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:55:31,288 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:55:31,288 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-03-11 22:55:31,288 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 22:55:31,288 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:31,288 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:55:31,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:55:31,288 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-11 22:55:31,288 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:31,289 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:31,289 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:31,289 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-11 22:55:31,289 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 22:55:31,389 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 22:55:31,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 22:55:31,393 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-11 22:55:31,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-11 22:55:31,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:31,394 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-03-11 22:55:31,394 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:55:31,394 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-11 22:55:31,394 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-11 22:55:31,395 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:31,395 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:31,395 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:55:31,395 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:31,396 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:55:31,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:55:31,396 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:31,396 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 22:55:31,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:31,396 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:31,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 22:55:31,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:31,396 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:31,397 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-03-11 22:55:31,397 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:31,397 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-11 22:55:31,397 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:55:31,397 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-11 22:55:31,397 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 22:55:31,397 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 22:55:31,397 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1678575322911.5cb27d102005ece125b41111cbb6d846. 2023-03-11 22:55:31,397 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1678575322911.5cb27d102005ece125b41111cbb6d846. started... 2023-03-11 22:55:31,397 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 5cb27d102005ece125b41111cbb6d846 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-11 22:55:31,810 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010333d3483234e64299a83f091ca1ba1e23 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2016010333d3483234e64299a83f091ca1ba1e23 2023-03-11 22:55:32,215 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithMonthlyPolicy/5cb27d102005ece125b41111cbb6d846/.tmp/family1/62707bf1bda14be58492ce38e7232d6c 2023-03-11 22:55:32,219 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithMonthlyPolicy/5cb27d102005ece125b41111cbb6d846/.tmp/family1/62707bf1bda14be58492ce38e7232d6c as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithMonthlyPolicy/5cb27d102005ece125b41111cbb6d846/family1/62707bf1bda14be58492ce38e7232d6c 2023-03-11 22:55:32,225 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithMonthlyPolicy/5cb27d102005ece125b41111cbb6d846/family1/62707bf1bda14be58492ce38e7232d6c, entries=1, sequenceid=33, filesize=4.9 K 2023-03-11 22:55:32,226 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 5cb27d102005ece125b41111cbb6d846 in 829ms, sequenceid=33, compaction requested=true 2023-03-11 22:55:32,226 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 5cb27d102005ece125b41111cbb6d846: 2023-03-11 22:55:32,226 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1678575322911.5cb27d102005ece125b41111cbb6d846. 2023-03-11 22:55:32,226 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 22:55:32,226 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 22:55:32,226 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:32,226 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-03-11 22:55:32,226 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-03-11 22:55:32,227 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:32,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:32,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:55:32,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:55:32,227 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:32,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:55:32,227 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:32,227 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 22:55:32,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:55:32,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:32,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:32,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:55:32,228 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-03-11 22:55:32,228 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5248fd22[Count = 0] remaining members to acquire global barrier 2023-03-11 22:55:32,228 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-11 22:55:32,228 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:32,229 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:32,229 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:32,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:32,229 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-11 22:55:32,229 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-03-11 22:55:32,229 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,41843,1678575183185' in zk 2023-03-11 22:55:32,229 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:32,229 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 22:55:32,231 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:32,231 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-11 22:55:32,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:32,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:55:32,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:55:32,231 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:55:32,231 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-03-11 22:55:32,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:55:32,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:55:32,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:32,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:32,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:55:32,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:32,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:32,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,41843,1678575183185': 2023-03-11 22:55:32,233 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-11 22:55:32,233 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-03-11 22:55:32,233 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 22:55:32,233 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 22:55:32,233 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:32,233 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 22:55:32,234 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:32,234 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:32,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:32,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:55:32,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:55:32,234 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:55:32,234 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:32,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:32,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:55:32,234 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:32,234 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:55:32,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:55:32,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:32,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:32,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:55:32,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:32,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:32,235 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:32,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:55:32,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:32,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:32,237 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:55:32,237 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:32,237 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:55:32,237 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-11 22:55:32,237 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:55:32,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:55:32,237 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-03-11 22:55:32,237 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 22:55:32,237 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:55:32,237 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:32,238 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:32,238 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:32,238 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:55:32,238 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:32,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:55:32,238 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-11 22:55:32,238 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:32,238 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:32,238 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 22:55:32,338 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 22:55:32,339 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 22:55:32,344 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-11 22:55:32,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-11 22:55:32,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:32,348 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-03-11 22:55:32,348 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:55:32,348 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-11 22:55:32,348 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-11 22:55:32,348 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:32,348 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:32,354 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:55:32,354 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:32,354 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:55:32,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:55:32,354 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:32,354 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 22:55:32,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:32,355 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:32,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 22:55:32,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:32,355 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:32,360 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-03-11 22:55:32,360 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:32,360 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-11 22:55:32,360 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:55:32,361 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-11 22:55:32,364 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 22:55:32,364 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1678575322911.5cb27d102005ece125b41111cbb6d846. 2023-03-11 22:55:32,364 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 22:55:32,364 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1678575322911.5cb27d102005ece125b41111cbb6d846. started... 2023-03-11 22:55:32,364 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 5cb27d102005ece125b41111cbb6d846 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-11 22:55:32,785 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015090774e82e3268cc4402b140725d451a8fc4 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015090774e82e3268cc4402b140725d451a8fc4 2023-03-11 22:55:32,789 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithMonthlyPolicy/5cb27d102005ece125b41111cbb6d846/.tmp/family1/0bb28a12c6c6404f984979df037df227 2023-03-11 22:55:32,793 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithMonthlyPolicy/5cb27d102005ece125b41111cbb6d846/.tmp/family1/0bb28a12c6c6404f984979df037df227 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithMonthlyPolicy/5cb27d102005ece125b41111cbb6d846/family1/0bb28a12c6c6404f984979df037df227 2023-03-11 22:55:32,796 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithMonthlyPolicy/5cb27d102005ece125b41111cbb6d846/family1/0bb28a12c6c6404f984979df037df227, entries=1, sequenceid=37, filesize=4.9 K 2023-03-11 22:55:32,797 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 5cb27d102005ece125b41111cbb6d846 in 433ms, sequenceid=37, compaction requested=true 2023-03-11 22:55:32,797 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 5cb27d102005ece125b41111cbb6d846: 2023-03-11 22:55:32,797 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1678575322911.5cb27d102005ece125b41111cbb6d846. 2023-03-11 22:55:32,797 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 22:55:32,797 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 22:55:32,797 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:32,797 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-03-11 22:55:32,797 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-03-11 22:55:32,798 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:32,798 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:32,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:32,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:55:32,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:55:32,798 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:32,798 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 22:55:32,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:55:32,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:55:32,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:32,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:32,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:55:32,800 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-03-11 22:55:32,800 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@307b60db[Count = 0] remaining members to acquire global barrier 2023-03-11 22:55:32,800 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-11 22:55:32,800 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:32,800 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:32,800 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:32,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:32,800 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-11 22:55:32,800 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-03-11 22:55:32,800 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:32,800 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 22:55:32,800 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,41843,1678575183185' in zk 2023-03-11 22:55:32,801 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-11 22:55:32,801 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:32,801 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:55:32,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:32,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:55:32,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:55:32,801 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-03-11 22:55:32,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:55:32,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:55:32,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:32,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:32,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:55:32,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:32,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:32,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,41843,1678575183185': 2023-03-11 22:55:32,803 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-11 22:55:32,803 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-03-11 22:55:32,803 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 22:55:32,803 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 22:55:32,803 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:32,803 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 22:55:32,804 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:32,804 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:32,804 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:32,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:32,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:55:32,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:55:32,804 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:55:32,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:32,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:55:32,804 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:32,804 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:55:32,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:55:32,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:32,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:32,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:55:32,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:32,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:32,805 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:32,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:55:32,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:32,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:32,806 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:55:32,806 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:32,806 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:55:32,806 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:55:32,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:55:32,807 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-11 22:55:32,806 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:32,807 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-03-11 22:55:32,807 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 22:55:32,807 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:55:32,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:55:32,806 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:55:32,807 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:32,807 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:32,807 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:32,807 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:32,807 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-11 22:55:32,807 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:32,807 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 22:55:32,907 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 22:55:32,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 22:55:32,911 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-11 22:55:32,913 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-11 22:55:32,913 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:32,913 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-03-11 22:55:32,913 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:55:32,913 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-11 22:55:32,913 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-11 22:55:32,913 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:32,913 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:32,914 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:55:32,914 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:32,914 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:55:32,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:55:32,914 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:32,914 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 22:55:32,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:32,915 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:32,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 22:55:32,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:32,915 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:32,915 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-03-11 22:55:32,915 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:32,915 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-11 22:55:32,915 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:55:32,915 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-11 22:55:32,915 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-11 22:55:32,915 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 22:55:32,915 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1678575322911.5cb27d102005ece125b41111cbb6d846. 2023-03-11 22:55:32,916 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1678575322911.5cb27d102005ece125b41111cbb6d846. started... 2023-03-11 22:55:32,916 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 5cb27d102005ece125b41111cbb6d846 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-11 22:55:33,327 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112071b8ebd3dfe748d1a3f935d3d398d809 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015112071b8ebd3dfe748d1a3f935d3d398d809 2023-03-11 22:55:33,334 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithMonthlyPolicy/5cb27d102005ece125b41111cbb6d846/.tmp/family1/eb366180c79c49b880b940c520025e69 2023-03-11 22:55:33,337 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithMonthlyPolicy/5cb27d102005ece125b41111cbb6d846/.tmp/family1/eb366180c79c49b880b940c520025e69 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithMonthlyPolicy/5cb27d102005ece125b41111cbb6d846/family1/eb366180c79c49b880b940c520025e69 2023-03-11 22:55:33,340 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithMonthlyPolicy/5cb27d102005ece125b41111cbb6d846/family1/eb366180c79c49b880b940c520025e69, entries=1, sequenceid=41, filesize=4.9 K 2023-03-11 22:55:33,341 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 5cb27d102005ece125b41111cbb6d846 in 425ms, sequenceid=41, compaction requested=true 2023-03-11 22:55:33,341 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 5cb27d102005ece125b41111cbb6d846: 2023-03-11 22:55:33,341 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1678575322911.5cb27d102005ece125b41111cbb6d846. 2023-03-11 22:55:33,341 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-11 22:55:33,341 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-11 22:55:33,341 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:33,341 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-03-11 22:55:33,341 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-03-11 22:55:33,342 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:33,342 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:33,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:33,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:55:33,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:55:33,342 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:33,342 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 22:55:33,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:55:33,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:55:33,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:33,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:33,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:55:33,343 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-03-11 22:55:33,343 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@65c68686[Count = 0] remaining members to acquire global barrier 2023-03-11 22:55:33,343 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-11 22:55:33,343 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:33,344 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:33,344 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:33,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:33,344 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:33,344 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 22:55:33,344 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-11 22:55:33,344 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-03-11 22:55:33,344 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,41843,1678575183185' in zk 2023-03-11 22:55:33,345 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-11 22:55:33,345 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:55:33,345 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:33,345 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-03-11 22:55:33,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:33,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:55:33,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:55:33,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:55:33,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:55:33,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:33,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:33,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:55:33,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:33,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:33,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,41843,1678575183185': 2023-03-11 22:55:33,347 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-11 22:55:33,347 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-03-11 22:55:33,347 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 22:55:33,347 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 22:55:33,347 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:33,347 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 22:55:33,348 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:33,348 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:33,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:33,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:55:33,348 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:33,348 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:55:33,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:33,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:55:33,348 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:33,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:55:33,348 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:55:33,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:55:33,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:33,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:33,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:55:33,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:33,349 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:33,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:33,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:55:33,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:33,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:33,350 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:33,350 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:33,350 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:33,350 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:33,350 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:55:33,350 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:55:33,350 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-03-11 22:55:33,350 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 22:55:33,350 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:33,350 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:55:33,350 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:55:33,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:55:33,350 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:33,350 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-11 22:55:33,350 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:33,350 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-11 22:55:33,350 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:55:33,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:55:33,350 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 22:55:33,451 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 22:55:33,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 22:55:33,452 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=44347] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMinorCompactionWithMonthlyPolicy 2023-03-11 22:55:33,454 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] procedure2.ProcedureExecutor(1029): Stored pid=115, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-03-11 22:55:33,454 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=115, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-03-11 22:55:33,455 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] mob.MobUtils(833): start MOB compaction of files for table='testMinorCompactionWithMonthlyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-11 22:55:33,455 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=115, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1678575933455 2023-03-11 22:55:33,457 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-03-11 22:55:33,457 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMinorCompactionWithMonthlyPolicy' and column 'family1' 2023-03-11 22:55:33,457 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-03-11 22:55:33,458 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] zookeeper.ReadOnlyZKClient(139): Connect 0x2b3a16f0 to 127.0.0.1:51815 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-11 22:55:33,462 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@61d6c3aa, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-11 22:55:33,462 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-03-11 22:55:33,900 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103cb48acb941b34f188829358fe04f9219 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103cb48acb941b34f188829358fe04f9219 2023-03-11 22:55:33,901 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-03-11 22:55:33,912 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-11 22:55:33,914 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:42930, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-11 22:55:33,919 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-11 22:55:33,920 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:37804, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-11 22:55:33,939 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/33e5b65db0684e318a38f4d2158a6925 first=Optional[r5] last=Optional[r6] 2023-03-11 22:55:33,940 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1678575322911.5cb27d102005ece125b41111cbb6d846., hostname=jenkins-hbase20.apache.org,41843,1678575183185, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/33e5b65db0684e318a38f4d2158a6925}] 2023-03-11 22:55:33,950 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/33e5b65db0684e318a38f4d2158a6925 for inclusion in 5cb27d102005ece125b41111cbb6d846/family1 2023-03-11 22:55:33,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.HStore(775): HFile bounds: first=r5 last=r6 2023-03-11 22:55:33,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.HStore(777): Region bounds: first= last= 2023-03-11 22:55:33,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.HRegion(2446): Flush status journal for 5cb27d102005ece125b41111cbb6d846: 2023-03-11 22:55:33,955 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/33e5b65db0684e318a38f4d2158a6925 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testMinorCompactionWithMonthlyPolicy__7amoacfp05gtbfh7epmoc3b3b760cpbipte7pe9s2vdlbbil2i1rijpjget99guj/family1/33e5b65db0684e318a38f4d2158a6925 2023-03-11 22:55:33,957 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testMinorCompactionWithMonthlyPolicy__7amoacfp05gtbfh7epmoc3b3b760cpbipte7pe9s2vdlbbil2i1rijpjget99guj/family1/33e5b65db0684e318a38f4d2158a6925 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithMonthlyPolicy/5cb27d102005ece125b41111cbb6d846/family1/8f93a8877c4f4e058f40d3d241e1de7a_SeqId_44_ 2023-03-11 22:55:33,957 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testMinorCompactionWithMonthlyPolicy__7amoacfp05gtbfh7epmoc3b3b760cpbipte7pe9s2vdlbbil2i1rijpjget99guj/family1/33e5b65db0684e318a38f4d2158a6925 into 5cb27d102005ece125b41111cbb6d846/family1 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithMonthlyPolicy/5cb27d102005ece125b41111cbb6d846/family1/8f93a8877c4f4e058f40d3d241e1de7a_SeqId_44_ - updating store file list. 2023-03-11 22:55:33,961 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithMonthlyPolicy/5cb27d102005ece125b41111cbb6d846/family1/8f93a8877c4f4e058f40d3d241e1de7a_SeqId_44_ into 5cb27d102005ece125b41111cbb6d846/family1 2023-03-11 22:55:33,961 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testMinorCompactionWithMonthlyPolicy__7amoacfp05gtbfh7epmoc3b3b760cpbipte7pe9s2vdlbbil2i1rijpjget99guj/family1/33e5b65db0684e318a38f4d2158a6925 into 5cb27d102005ece125b41111cbb6d846/family1 (new location: hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithMonthlyPolicy/5cb27d102005ece125b41111cbb6d846/family1/8f93a8877c4f4e058f40d3d241e1de7a_SeqId_44_) 2023-03-11 22:55:33,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testMinorCompactionWithMonthlyPolicy__7amoacfp05gtbfh7epmoc3b3b760cpbipte7pe9s2vdlbbil2i1rijpjget99guj/family1/33e5b65db0684e318a38f4d2158a6925 2023-03-11 22:55:33,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-03-11 22:55:33,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 50903 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-03-11 22:55:33,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.HStore(1912): 5cb27d102005ece125b41111cbb6d846/family1 is initiating minor compaction 2023-03-11 22:55:33,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@50d815b; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-11 22:55:33,972 INFO [RS:0;jenkins-hbase20:41843-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 5cb27d102005ece125b41111cbb6d846/family1 in testMinorCompactionWithMonthlyPolicy,,1678575322911.5cb27d102005ece125b41111cbb6d846. 2023-03-11 22:55:33,972 INFO [RS:0;jenkins-hbase20:41843-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithMonthlyPolicy/5cb27d102005ece125b41111cbb6d846/family1/158eea336522437b8a33fb4d39cb27bc, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithMonthlyPolicy/5cb27d102005ece125b41111cbb6d846/family1/a7ab786aa5e24a1b80775d9d7b0dd965, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithMonthlyPolicy/5cb27d102005ece125b41111cbb6d846/family1/fff1f47cc9134ac49920119eff6b9cf9, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithMonthlyPolicy/5cb27d102005ece125b41111cbb6d846/family1/2060eb64831f4a98b7a132bd80cb0a6f, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithMonthlyPolicy/5cb27d102005ece125b41111cbb6d846/family1/531d5b59802c407ea96b016d8af61b88, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithMonthlyPolicy/5cb27d102005ece125b41111cbb6d846/family1/656777e2da3d4c55894a2eb00d830150, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithMonthlyPolicy/5cb27d102005ece125b41111cbb6d846/family1/62707bf1bda14be58492ce38e7232d6c, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithMonthlyPolicy/5cb27d102005ece125b41111cbb6d846/family1/0bb28a12c6c6404f984979df037df227, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithMonthlyPolicy/5cb27d102005ece125b41111cbb6d846/family1/eb366180c79c49b880b940c520025e69, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithMonthlyPolicy/5cb27d102005ece125b41111cbb6d846/family1/8f93a8877c4f4e058f40d3d241e1de7a_SeqId_44_] into tmpdir=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithMonthlyPolicy/5cb27d102005ece125b41111cbb6d846/.tmp, totalSize=49.7 K 2023-03-11 22:55:33,973 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] compactions.Compactor(207): Compacting 158eea336522437b8a33fb4d39cb27bc, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-03-11 22:55:33,973 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] compactions.Compactor(207): Compacting a7ab786aa5e24a1b80775d9d7b0dd965, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-03-11 22:55:33,973 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] compactions.Compactor(207): Compacting fff1f47cc9134ac49920119eff6b9cf9, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-03-11 22:55:33,973 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] compactions.Compactor(207): Compacting 2060eb64831f4a98b7a132bd80cb0a6f, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-03-11 22:55:33,973 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] compactions.Compactor(207): Compacting 531d5b59802c407ea96b016d8af61b88, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-03-11 22:55:33,973 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] compactions.Compactor(207): Compacting 656777e2da3d4c55894a2eb00d830150, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-03-11 22:55:33,973 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] compactions.Compactor(207): Compacting 62707bf1bda14be58492ce38e7232d6c, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-03-11 22:55:33,973 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] compactions.Compactor(207): Compacting 0bb28a12c6c6404f984979df037df227, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-03-11 22:55:33,973 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] compactions.Compactor(207): Compacting eb366180c79c49b880b940c520025e69, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-03-11 22:55:33,973 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] compactions.Compactor(207): Compacting 8f93a8877c4f4e058f40d3d241e1de7a_SeqId_44_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=45 2023-03-11 22:55:33,974 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-03-11 22:55:33,974 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 22:55:33,976 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2016010141ebb728ae2a4671bccb2092f3599db1 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2016010141ebb728ae2a4671bccb2092f3599db1 2023-03-11 22:55:33,977 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2016010333d3483234e64299a83f091ca1ba1e23 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2016010333d3483234e64299a83f091ca1ba1e23 2023-03-11 22:55:33,977 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 2 expired mob files are deleted 2023-03-11 22:55:33,977 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101' 2023-03-11 22:55:33,978 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-03-11 22:55:33,978 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-03-11 22:55:33,998 INFO [RS:0;jenkins-hbase20:41843-shortCompactions-0] throttle.PressureAwareThroughputController(145): 5cb27d102005ece125b41111cbb6d846#family1#compaction#166 average throughput is 0.34 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-11 22:55:34,410 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithMonthlyPolicy/5cb27d102005ece125b41111cbb6d846/.tmp/family1/971a9a05accf4f1daa046355130ea50f as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithMonthlyPolicy/5cb27d102005ece125b41111cbb6d846/family1/971a9a05accf4f1daa046355130ea50f 2023-03-11 22:55:34,417 INFO [RS:0;jenkins-hbase20:41843-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 5cb27d102005ece125b41111cbb6d846/family1 of 5cb27d102005ece125b41111cbb6d846 into 971a9a05accf4f1daa046355130ea50f(size=6.6 K), total size for store is 172.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-11 22:55:34,417 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 5cb27d102005ece125b41111cbb6d846: 2023-03-11 22:55:34,417 INFO [RS:0;jenkins-hbase20:41843-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithMonthlyPolicy,,1678575322911.5cb27d102005ece125b41111cbb6d846., storeName=family1, fileCount=10, fileSize=49.7 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.2 K), priority=2, time=1678575333972; duration=0sec 2023-03-11 22:55:34,417 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-11 22:55:34,421 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231286a3a35ee7841bfa5de0064a346046b to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231286a3a35ee7841bfa5de0064a346046b 2023-03-11 22:55:34,422 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-03-11 22:55:34,444 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/9ca8e358e1294aa589c01216b8a75b78 first=Optional[r1] last=Optional[r4] 2023-03-11 22:55:34,445 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1678575322911.5cb27d102005ece125b41111cbb6d846., hostname=jenkins-hbase20.apache.org,41843,1678575183185, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/9ca8e358e1294aa589c01216b8a75b78}] 2023-03-11 22:55:34,449 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/9ca8e358e1294aa589c01216b8a75b78 for inclusion in 5cb27d102005ece125b41111cbb6d846/family1 2023-03-11 22:55:34,452 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.HStore(775): HFile bounds: first=r1 last=r4 2023-03-11 22:55:34,452 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.HStore(777): Region bounds: first= last= 2023-03-11 22:55:34,452 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.HRegion(2446): Flush status journal for 5cb27d102005ece125b41111cbb6d846: 2023-03-11 22:55:34,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/9ca8e358e1294aa589c01216b8a75b78 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testMinorCompactionWithMonthlyPolicy__ai32n1is7h1m85dr94910q1b7ivsuu5b623baocsb4gbagncmjat0svquo2ubtff/family1/9ca8e358e1294aa589c01216b8a75b78 2023-03-11 22:55:34,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testMinorCompactionWithMonthlyPolicy__ai32n1is7h1m85dr94910q1b7ivsuu5b623baocsb4gbagncmjat0svquo2ubtff/family1/9ca8e358e1294aa589c01216b8a75b78 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithMonthlyPolicy/5cb27d102005ece125b41111cbb6d846/family1/6526eb00201e4593921b77c4df9a5b91_SeqId_47_ 2023-03-11 22:55:34,456 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testMinorCompactionWithMonthlyPolicy__ai32n1is7h1m85dr94910q1b7ivsuu5b623baocsb4gbagncmjat0svquo2ubtff/family1/9ca8e358e1294aa589c01216b8a75b78 into 5cb27d102005ece125b41111cbb6d846/family1 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithMonthlyPolicy/5cb27d102005ece125b41111cbb6d846/family1/6526eb00201e4593921b77c4df9a5b91_SeqId_47_ - updating store file list. 2023-03-11 22:55:34,460 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithMonthlyPolicy/5cb27d102005ece125b41111cbb6d846/family1/6526eb00201e4593921b77c4df9a5b91_SeqId_47_ into 5cb27d102005ece125b41111cbb6d846/family1 2023-03-11 22:55:34,460 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testMinorCompactionWithMonthlyPolicy__ai32n1is7h1m85dr94910q1b7ivsuu5b623baocsb4gbagncmjat0svquo2ubtff/family1/9ca8e358e1294aa589c01216b8a75b78 into 5cb27d102005ece125b41111cbb6d846/family1 (new location: hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithMonthlyPolicy/5cb27d102005ece125b41111cbb6d846/family1/6526eb00201e4593921b77c4df9a5b91_SeqId_47_) 2023-03-11 22:55:34,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testMinorCompactionWithMonthlyPolicy__ai32n1is7h1m85dr94910q1b7ivsuu5b623baocsb4gbagncmjat0svquo2ubtff/family1/9ca8e358e1294aa589c01216b8a75b78 2023-03-11 22:55:34,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-03-11 22:55:34,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 182349 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-03-11 22:55:34,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.HStore(1912): 5cb27d102005ece125b41111cbb6d846/family1 is initiating minor compaction (all files) 2023-03-11 22:55:34,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@7c2e2eef; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-11 22:55:34,462 INFO [RS:0;jenkins-hbase20:41843-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 5cb27d102005ece125b41111cbb6d846/family1 in testMinorCompactionWithMonthlyPolicy,,1678575322911.5cb27d102005ece125b41111cbb6d846. 2023-03-11 22:55:34,462 INFO [RS:0;jenkins-hbase20:41843-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithMonthlyPolicy/5cb27d102005ece125b41111cbb6d846/family1/12a72e224cfa4d81927034f8c982ee1e, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithMonthlyPolicy/5cb27d102005ece125b41111cbb6d846/family1/971a9a05accf4f1daa046355130ea50f, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithMonthlyPolicy/5cb27d102005ece125b41111cbb6d846/family1/6526eb00201e4593921b77c4df9a5b91_SeqId_47_] into tmpdir=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithMonthlyPolicy/5cb27d102005ece125b41111cbb6d846/.tmp, totalSize=178.1 K 2023-03-11 22:55:34,462 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] compactions.Compactor(207): Compacting 12a72e224cfa4d81927034f8c982ee1e, keycount=1000, bloomtype=ROW, size=166.0 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878807597 2023-03-11 22:55:34,463 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] compactions.Compactor(207): Compacting 971a9a05accf4f1daa046355130ea50f, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621207597 2023-03-11 22:55:34,463 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] compactions.Compactor(207): Compacting 6526eb00201e4593921b77c4df9a5b91_SeqId_47_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965207597 2023-03-11 22:55:34,464 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-03-11 22:55:34,464 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 22:55:34,466 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithMonthlyPolicy/5cb27d102005ece125b41111cbb6d846/family1/158eea336522437b8a33fb4d39cb27bc, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithMonthlyPolicy/5cb27d102005ece125b41111cbb6d846/family1/a7ab786aa5e24a1b80775d9d7b0dd965, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithMonthlyPolicy/5cb27d102005ece125b41111cbb6d846/family1/fff1f47cc9134ac49920119eff6b9cf9, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithMonthlyPolicy/5cb27d102005ece125b41111cbb6d846/family1/2060eb64831f4a98b7a132bd80cb0a6f, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithMonthlyPolicy/5cb27d102005ece125b41111cbb6d846/family1/531d5b59802c407ea96b016d8af61b88, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithMonthlyPolicy/5cb27d102005ece125b41111cbb6d846/family1/656777e2da3d4c55894a2eb00d830150, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithMonthlyPolicy/5cb27d102005ece125b41111cbb6d846/family1/62707bf1bda14be58492ce38e7232d6c, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithMonthlyPolicy/5cb27d102005ece125b41111cbb6d846/family1/0bb28a12c6c6404f984979df037df227, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithMonthlyPolicy/5cb27d102005ece125b41111cbb6d846/family1/eb366180c79c49b880b940c520025e69, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithMonthlyPolicy/5cb27d102005ece125b41111cbb6d846/family1/8f93a8877c4f4e058f40d3d241e1de7a_SeqId_44_] to archive 2023-03-11 22:55:34,467 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 22:55:34,469 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151201feda42af062542f18cd70a5ab0a43428 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151201feda42af062542f18cd70a5ab0a43428 2023-03-11 22:55:34,470 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithMonthlyPolicy/5cb27d102005ece125b41111cbb6d846/family1/158eea336522437b8a33fb4d39cb27bc to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMinorCompactionWithMonthlyPolicy/5cb27d102005ece125b41111cbb6d846/family1/158eea336522437b8a33fb4d39cb27bc 2023-03-11 22:55:34,470 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015120547e82381d6294091bedf5d41b37c384a to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015120547e82381d6294091bedf5d41b37c384a 2023-03-11 22:55:34,471 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithMonthlyPolicy/5cb27d102005ece125b41111cbb6d846/family1/a7ab786aa5e24a1b80775d9d7b0dd965 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMinorCompactionWithMonthlyPolicy/5cb27d102005ece125b41111cbb6d846/family1/a7ab786aa5e24a1b80775d9d7b0dd965 2023-03-11 22:55:34,472 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512285cdeb2784cc54fab94b8421b01399703 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512285cdeb2784cc54fab94b8421b01399703 2023-03-11 22:55:34,472 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithMonthlyPolicy/5cb27d102005ece125b41111cbb6d846/family1/fff1f47cc9134ac49920119eff6b9cf9 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMinorCompactionWithMonthlyPolicy/5cb27d102005ece125b41111cbb6d846/family1/fff1f47cc9134ac49920119eff6b9cf9 2023-03-11 22:55:34,473 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231d0bc50941eb54ec2994a09ec2cbd9197 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231d0bc50941eb54ec2994a09ec2cbd9197 2023-03-11 22:55:34,473 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 4 expired mob files are deleted 2023-03-11 22:55:34,473 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201' 2023-03-11 22:55:34,473 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-03-11 22:55:34,473 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-03-11 22:55:34,473 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithMonthlyPolicy/5cb27d102005ece125b41111cbb6d846/family1/2060eb64831f4a98b7a132bd80cb0a6f to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMinorCompactionWithMonthlyPolicy/5cb27d102005ece125b41111cbb6d846/family1/2060eb64831f4a98b7a132bd80cb0a6f 2023-03-11 22:55:34,474 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithMonthlyPolicy/5cb27d102005ece125b41111cbb6d846/family1/531d5b59802c407ea96b016d8af61b88 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMinorCompactionWithMonthlyPolicy/5cb27d102005ece125b41111cbb6d846/family1/531d5b59802c407ea96b016d8af61b88 2023-03-11 22:55:34,475 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithMonthlyPolicy/5cb27d102005ece125b41111cbb6d846/family1/656777e2da3d4c55894a2eb00d830150 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMinorCompactionWithMonthlyPolicy/5cb27d102005ece125b41111cbb6d846/family1/656777e2da3d4c55894a2eb00d830150 2023-03-11 22:55:34,476 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithMonthlyPolicy/5cb27d102005ece125b41111cbb6d846/family1/62707bf1bda14be58492ce38e7232d6c to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMinorCompactionWithMonthlyPolicy/5cb27d102005ece125b41111cbb6d846/family1/62707bf1bda14be58492ce38e7232d6c 2023-03-11 22:55:34,478 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithMonthlyPolicy/5cb27d102005ece125b41111cbb6d846/family1/0bb28a12c6c6404f984979df037df227 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMinorCompactionWithMonthlyPolicy/5cb27d102005ece125b41111cbb6d846/family1/0bb28a12c6c6404f984979df037df227 2023-03-11 22:55:34,479 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithMonthlyPolicy/5cb27d102005ece125b41111cbb6d846/family1/eb366180c79c49b880b940c520025e69 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMinorCompactionWithMonthlyPolicy/5cb27d102005ece125b41111cbb6d846/family1/eb366180c79c49b880b940c520025e69 2023-03-11 22:55:34,481 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithMonthlyPolicy/5cb27d102005ece125b41111cbb6d846/family1/8f93a8877c4f4e058f40d3d241e1de7a_SeqId_44_ to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMinorCompactionWithMonthlyPolicy/5cb27d102005ece125b41111cbb6d846/family1/8f93a8877c4f4e058f40d3d241e1de7a_SeqId_44_ 2023-03-11 22:55:34,497 INFO [RS:0;jenkins-hbase20:41843-shortCompactions-0] throttle.PressureAwareThroughputController(145): 5cb27d102005ece125b41111cbb6d846#family1#compaction#167 average throughput is 6.48 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-11 22:55:35,346 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015113045bc9143b9a94be09b1096f45a232453 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015113045bc9143b9a94be09b1096f45a232453 2023-03-11 22:55:35,347 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-03-11 22:55:35,370 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/7f04328cd8354b819f6c304c5fa718b2 first=Optional[r00] last=Optional[r8] 2023-03-11 22:55:35,370 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1678575322911.5cb27d102005ece125b41111cbb6d846., hostname=jenkins-hbase20.apache.org,41843,1678575183185, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/7f04328cd8354b819f6c304c5fa718b2}] 2023-03-11 22:55:35,372 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/7f04328cd8354b819f6c304c5fa718b2 for inclusion in 5cb27d102005ece125b41111cbb6d846/family1 2023-03-11 22:55:35,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.HStore(775): HFile bounds: first=r00 last=r8 2023-03-11 22:55:35,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.HStore(777): Region bounds: first= last= 2023-03-11 22:55:35,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.HRegion(2446): Flush status journal for 5cb27d102005ece125b41111cbb6d846: 2023-03-11 22:55:35,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/7f04328cd8354b819f6c304c5fa718b2 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testMinorCompactionWithMonthlyPolicy__la4hkedqpaqt7tc65t1ulh0pj9rlmvgue88mgjntptms48fhep6fsst8664va17h/family1/7f04328cd8354b819f6c304c5fa718b2 2023-03-11 22:55:35,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testMinorCompactionWithMonthlyPolicy__la4hkedqpaqt7tc65t1ulh0pj9rlmvgue88mgjntptms48fhep6fsst8664va17h/family1/7f04328cd8354b819f6c304c5fa718b2 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithMonthlyPolicy/5cb27d102005ece125b41111cbb6d846/family1/1fab4f2dc995472b8d7b33c046644e4e_SeqId_49_ 2023-03-11 22:55:35,377 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testMinorCompactionWithMonthlyPolicy__la4hkedqpaqt7tc65t1ulh0pj9rlmvgue88mgjntptms48fhep6fsst8664va17h/family1/7f04328cd8354b819f6c304c5fa718b2 into 5cb27d102005ece125b41111cbb6d846/family1 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithMonthlyPolicy/5cb27d102005ece125b41111cbb6d846/family1/1fab4f2dc995472b8d7b33c046644e4e_SeqId_49_ - updating store file list. 2023-03-11 22:55:35,379 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithMonthlyPolicy/5cb27d102005ece125b41111cbb6d846/family1/1fab4f2dc995472b8d7b33c046644e4e_SeqId_49_ into 5cb27d102005ece125b41111cbb6d846/family1 2023-03-11 22:55:35,379 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testMinorCompactionWithMonthlyPolicy__la4hkedqpaqt7tc65t1ulh0pj9rlmvgue88mgjntptms48fhep6fsst8664va17h/family1/7f04328cd8354b819f6c304c5fa718b2 into 5cb27d102005ece125b41111cbb6d846/family1 (new location: hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithMonthlyPolicy/5cb27d102005ece125b41111cbb6d846/family1/1fab4f2dc995472b8d7b33c046644e4e_SeqId_49_) 2023-03-11 22:55:35,379 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testMinorCompactionWithMonthlyPolicy__la4hkedqpaqt7tc65t1ulh0pj9rlmvgue88mgjntptms48fhep6fsst8664va17h/family1/7f04328cd8354b819f6c304c5fa718b2 2023-03-11 22:55:35,381 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-03-11 22:55:35,381 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 22:55:35,382 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015112071b8ebd3dfe748d1a3f935d3d398d809 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015112071b8ebd3dfe748d1a3f935d3d398d809 2023-03-11 22:55:35,383 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511287a3b1f1496b44ba298dbf21608cd9498 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511287a3b1f1496b44ba298dbf21608cd9498 2023-03-11 22:55:35,384 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151130d3c537bfb3a74c71a03945e01733976c to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151130d3c537bfb3a74c71a03945e01733976c 2023-03-11 22:55:35,384 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 3 expired mob files are deleted 2023-03-11 22:55:35,384 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-03-11 22:55:35,385 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-03-11 22:55:35,385 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-03-11 22:55:35,385 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-03-11 22:55:35,385 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-03-11 22:55:35,385 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] mob.MobUtils(840): end MOB compaction of files for table='testMinorCompactionWithMonthlyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-11 22:55:35,387 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=115, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-03-11 22:55:35,389 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=115, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE in 1.9340 sec 2023-03-11 22:55:35,570 INFO [Listener at localhost.localdomain/41563] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompactionWithMonthlyPolicy Thread=255 (was 247) - Thread LEAK? -, OpenFileDescriptor=642 (was 624) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=151 (was 185), ProcessCount=168 (was 168), AvailableMemoryMB=22558 (was 21441) - AvailableMemoryMB LEAK? - 2023-03-11 22:55:35,582 INFO [Listener at localhost.localdomain/41563] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionFromAdmin Thread=255, OpenFileDescriptor=642, MaxFileDescriptor=60000, SystemLoadAverage=151, ProcessCount=168, AvailableMemoryMB=22557 2023-03-11 22:55:35,600 DEBUG [Listener at localhost.localdomain/41563] crypto.Encryption(565): Installed org.apache.hadoop.hbase.io.crypto.KeyProviderForTesting into key provider cache 2023-03-11 22:55:35,656 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xA3\xBE^\xFAN\xEB\xB3{\xE6\x9FTA1x\xFF<"\x10\xF3x@]@\x0F\xAC\xE0Mv;u@\xF6\xAE\xE0*\x10\xE1~q\xC9zs;\xD6\x1B\x94!\x82\xD1\x93\x99\x872\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-03-11 22:55:35,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure2.ProcedureExecutor(1029): Stored pid=116, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionFromAdmin 2023-03-11 22:55:35,658 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_PRE_OPERATION 2023-03-11 22:55:35,659 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(697): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionFromAdmin" procId is: 116 2023-03-11 22:55:35,659 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-11 22:55:35,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-03-11 22:55:35,660 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/.tmp/data/default/testMajorCompactionFromAdmin/234c190ff73b29a4f3c5e6a6e630633f 2023-03-11 22:55:35,661 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/.tmp/data/default/testMajorCompactionFromAdmin/b1b55df2e1201b31717429b4c155b168 2023-03-11 22:55:35,661 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/.tmp/data/default/testMajorCompactionFromAdmin/1b0a50d6be32f97a1a81d7fd32d7f47b 2023-03-11 22:55:35,661 DEBUG [HFileArchiver-21] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/.tmp/data/default/testMajorCompactionFromAdmin/b1b55df2e1201b31717429b4c155b168 empty. 2023-03-11 22:55:35,661 DEBUG [HFileArchiver-22] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/.tmp/data/default/testMajorCompactionFromAdmin/1b0a50d6be32f97a1a81d7fd32d7f47b empty. 2023-03-11 22:55:35,661 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/.tmp/data/default/testMajorCompactionFromAdmin/234c190ff73b29a4f3c5e6a6e630633f empty. 2023-03-11 22:55:35,661 DEBUG [HFileArchiver-21] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/.tmp/data/default/testMajorCompactionFromAdmin/b1b55df2e1201b31717429b4c155b168 2023-03-11 22:55:35,661 DEBUG [HFileArchiver-22] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/.tmp/data/default/testMajorCompactionFromAdmin/1b0a50d6be32f97a1a81d7fd32d7f47b 2023-03-11 22:55:35,661 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/.tmp/data/default/testMajorCompactionFromAdmin/234c190ff73b29a4f3c5e6a6e630633f 2023-03-11 22:55:35,661 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testMajorCompactionFromAdmin regions 2023-03-11 22:55:35,749 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithMonthlyPolicy/5cb27d102005ece125b41111cbb6d846/.tmp/family1/b938bae1b8454536b3e1b287f1c5edd1 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithMonthlyPolicy/5cb27d102005ece125b41111cbb6d846/family1/b938bae1b8454536b3e1b287f1c5edd1 2023-03-11 22:55:35,755 INFO [RS:0;jenkins-hbase20:41843-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 5cb27d102005ece125b41111cbb6d846/family1 of 5cb27d102005ece125b41111cbb6d846 into b938bae1b8454536b3e1b287f1c5edd1(size=167.4 K), total size for store is 333.6 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-11 22:55:35,755 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 5cb27d102005ece125b41111cbb6d846: 2023-03-11 22:55:35,755 INFO [RS:0;jenkins-hbase20:41843-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithMonthlyPolicy,,1678575322911.5cb27d102005ece125b41111cbb6d846., storeName=family1, fileCount=3, fileSize=178.1 K (166.0 K, 6.6 K, 5.5 K), priority=2, time=1678575334462; duration=1sec 2023-03-11 22:55:35,756 DEBUG [RS:0;jenkins-hbase20:41843-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-11 22:55:35,760 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-03-11 22:55:35,771 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithMonthlyPolicy/5cb27d102005ece125b41111cbb6d846/family1/12a72e224cfa4d81927034f8c982ee1e, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithMonthlyPolicy/5cb27d102005ece125b41111cbb6d846/family1/971a9a05accf4f1daa046355130ea50f, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithMonthlyPolicy/5cb27d102005ece125b41111cbb6d846/family1/6526eb00201e4593921b77c4df9a5b91_SeqId_47_] to archive 2023-03-11 22:55:35,772 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 22:55:35,773 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithMonthlyPolicy/5cb27d102005ece125b41111cbb6d846/family1/12a72e224cfa4d81927034f8c982ee1e to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMinorCompactionWithMonthlyPolicy/5cb27d102005ece125b41111cbb6d846/family1/12a72e224cfa4d81927034f8c982ee1e 2023-03-11 22:55:35,774 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithMonthlyPolicy/5cb27d102005ece125b41111cbb6d846/family1/971a9a05accf4f1daa046355130ea50f to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMinorCompactionWithMonthlyPolicy/5cb27d102005ece125b41111cbb6d846/family1/971a9a05accf4f1daa046355130ea50f 2023-03-11 22:55:35,775 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithMonthlyPolicy/5cb27d102005ece125b41111cbb6d846/family1/6526eb00201e4593921b77c4df9a5b91_SeqId_47_ to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMinorCompactionWithMonthlyPolicy/5cb27d102005ece125b41111cbb6d846/family1/6526eb00201e4593921b77c4df9a5b91_SeqId_47_ 2023-03-11 22:55:35,961 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-03-11 22:55:36,069 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/.tmp/data/default/testMajorCompactionFromAdmin/.tabledesc/.tableinfo.0000000001 2023-03-11 22:55:36,070 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(7675): creating {ENCODED => 234c190ff73b29a4f3c5e6a6e630633f, NAME => 'testMajorCompactionFromAdmin,,1678575335623.234c190ff73b29a4f3c5e6a6e630633f.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xA3\xBE^\xFAN\xEB\xB3{\xE6\x9FTA1x\xFF<"\x10\xF3x@]@\x0F\xAC\xE0Mv;u@\xF6\xAE\xE0*\x10\xE1~q\xC9zs;\xD6\x1B\x94!\x82\xD1\x93\x99\x872\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/.tmp 2023-03-11 22:55:36,071 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(7675): creating {ENCODED => 1b0a50d6be32f97a1a81d7fd32d7f47b, NAME => 'testMajorCompactionFromAdmin,2,1678575335623.1b0a50d6be32f97a1a81d7fd32d7f47b.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xA3\xBE^\xFAN\xEB\xB3{\xE6\x9FTA1x\xFF<"\x10\xF3x@]@\x0F\xAC\xE0Mv;u@\xF6\xAE\xE0*\x10\xE1~q\xC9zs;\xD6\x1B\x94!\x82\xD1\x93\x99\x872\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/.tmp 2023-03-11 22:55:36,071 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(7675): creating {ENCODED => b1b55df2e1201b31717429b4c155b168, NAME => 'testMajorCompactionFromAdmin,1,1678575335623.b1b55df2e1201b31717429b4c155b168.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xA3\xBE^\xFAN\xEB\xB3{\xE6\x9FTA1x\xFF<"\x10\xF3x@]@\x0F\xAC\xE0Mv;u@\xF6\xAE\xE0*\x10\xE1~q\xC9zs;\xD6\x1B\x94!\x82\xD1\x93\x99\x872\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/.tmp 2023-03-11 22:55:36,079 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,1,1678575335623.b1b55df2e1201b31717429b4c155b168.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-11 22:55:36,079 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1604): Closing b1b55df2e1201b31717429b4c155b168, disabling compactions & flushes 2023-03-11 22:55:36,079 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,1,1678575335623.b1b55df2e1201b31717429b4c155b168. 2023-03-11 22:55:36,079 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,1,1678575335623.b1b55df2e1201b31717429b4c155b168. 2023-03-11 22:55:36,079 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,1,1678575335623.b1b55df2e1201b31717429b4c155b168. after waiting 0 ms 2023-03-11 22:55:36,079 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,1,1678575335623.b1b55df2e1201b31717429b4c155b168. 2023-03-11 22:55:36,079 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,1,1678575335623.b1b55df2e1201b31717429b4c155b168. 2023-03-11 22:55:36,079 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1558): Region close journal for b1b55df2e1201b31717429b4c155b168: 2023-03-11 22:55:36,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-03-11 22:55:36,480 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,2,1678575335623.1b0a50d6be32f97a1a81d7fd32d7f47b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-11 22:55:36,480 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,,1678575335623.234c190ff73b29a4f3c5e6a6e630633f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-11 22:55:36,480 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1604): Closing 1b0a50d6be32f97a1a81d7fd32d7f47b, disabling compactions & flushes 2023-03-11 22:55:36,480 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1604): Closing 234c190ff73b29a4f3c5e6a6e630633f, disabling compactions & flushes 2023-03-11 22:55:36,481 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,,1678575335623.234c190ff73b29a4f3c5e6a6e630633f. 2023-03-11 22:55:36,481 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,,1678575335623.234c190ff73b29a4f3c5e6a6e630633f. 2023-03-11 22:55:36,481 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,,1678575335623.234c190ff73b29a4f3c5e6a6e630633f. after waiting 0 ms 2023-03-11 22:55:36,481 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,,1678575335623.234c190ff73b29a4f3c5e6a6e630633f. 2023-03-11 22:55:36,481 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,2,1678575335623.1b0a50d6be32f97a1a81d7fd32d7f47b. 2023-03-11 22:55:36,481 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,,1678575335623.234c190ff73b29a4f3c5e6a6e630633f. 2023-03-11 22:55:36,481 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,2,1678575335623.1b0a50d6be32f97a1a81d7fd32d7f47b. 2023-03-11 22:55:36,482 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1558): Region close journal for 234c190ff73b29a4f3c5e6a6e630633f: 2023-03-11 22:55:36,482 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,2,1678575335623.1b0a50d6be32f97a1a81d7fd32d7f47b. after waiting 0 ms 2023-03-11 22:55:36,482 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,2,1678575335623.1b0a50d6be32f97a1a81d7fd32d7f47b. 2023-03-11 22:55:36,482 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,2,1678575335623.1b0a50d6be32f97a1a81d7fd32d7f47b. 2023-03-11 22:55:36,482 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1558): Region close journal for 1b0a50d6be32f97a1a81d7fd32d7f47b: 2023-03-11 22:55:36,485 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_ADD_TO_META 2023-03-11 22:55:36,486 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,1,1678575335623.b1b55df2e1201b31717429b4c155b168.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1678575336486"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678575336486"}]},"ts":"1678575336486"} 2023-03-11 22:55:36,487 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,,1678575335623.234c190ff73b29a4f3c5e6a6e630633f.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1678575336486"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678575336486"}]},"ts":"1678575336486"} 2023-03-11 22:55:36,487 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,2,1678575335623.1b0a50d6be32f97a1a81d7fd32d7f47b.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1678575336486"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678575336486"}]},"ts":"1678575336486"} 2023-03-11 22:55:36,489 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-03-11 22:55:36,490 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-11 22:55:36,490 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionFromAdmin","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678575336490"}]},"ts":"1678575336490"} 2023-03-11 22:55:36,491 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionFromAdmin, state=ENABLING in hbase:meta 2023-03-11 22:55:36,494 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=234c190ff73b29a4f3c5e6a6e630633f, ASSIGN}, {pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=b1b55df2e1201b31717429b4c155b168, ASSIGN}, {pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=1b0a50d6be32f97a1a81d7fd32d7f47b, ASSIGN}] 2023-03-11 22:55:36,496 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=b1b55df2e1201b31717429b4c155b168, ASSIGN 2023-03-11 22:55:36,496 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=1b0a50d6be32f97a1a81d7fd32d7f47b, ASSIGN 2023-03-11 22:55:36,497 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=234c190ff73b29a4f3c5e6a6e630633f, ASSIGN 2023-03-11 22:55:36,497 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=b1b55df2e1201b31717429b4c155b168, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,41843,1678575183185; forceNewPlan=false, retain=false 2023-03-11 22:55:36,497 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=1b0a50d6be32f97a1a81d7fd32d7f47b, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,41843,1678575183185; forceNewPlan=false, retain=false 2023-03-11 22:55:36,497 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=234c190ff73b29a4f3c5e6a6e630633f, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,41843,1678575183185; forceNewPlan=false, retain=false 2023-03-11 22:55:36,651 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=119 updating hbase:meta row=1b0a50d6be32f97a1a81d7fd32d7f47b, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:36,651 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=b1b55df2e1201b31717429b4c155b168, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:36,651 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,2,1678575335623.1b0a50d6be32f97a1a81d7fd32d7f47b.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1678575336651"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1678575336651"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678575336651"}]},"ts":"1678575336651"} 2023-03-11 22:55:36,651 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,1,1678575335623.b1b55df2e1201b31717429b4c155b168.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1678575336651"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1678575336651"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678575336651"}]},"ts":"1678575336651"} 2023-03-11 22:55:36,651 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=117 updating hbase:meta row=234c190ff73b29a4f3c5e6a6e630633f, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:36,652 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,,1678575335623.234c190ff73b29a4f3c5e6a6e630633f.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1678575336651"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1678575336651"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678575336651"}]},"ts":"1678575336651"} 2023-03-11 22:55:36,655 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=120, ppid=119, state=RUNNABLE; OpenRegionProcedure 1b0a50d6be32f97a1a81d7fd32d7f47b, server=jenkins-hbase20.apache.org,41843,1678575183185}] 2023-03-11 22:55:36,656 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=121, ppid=118, state=RUNNABLE; OpenRegionProcedure b1b55df2e1201b31717429b4c155b168, server=jenkins-hbase20.apache.org,41843,1678575183185}] 2023-03-11 22:55:36,658 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=122, ppid=117, state=RUNNABLE; OpenRegionProcedure 234c190ff73b29a4f3c5e6a6e630633f, server=jenkins-hbase20.apache.org,41843,1678575183185}] 2023-03-11 22:55:36,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-03-11 22:55:36,812 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionFromAdmin,1,1678575335623.b1b55df2e1201b31717429b4c155b168. 2023-03-11 22:55:36,812 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b1b55df2e1201b31717429b4c155b168, NAME => 'testMajorCompactionFromAdmin,1,1678575335623.b1b55df2e1201b31717429b4c155b168.', STARTKEY => '1', ENDKEY => '2'} 2023-03-11 22:55:36,813 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin b1b55df2e1201b31717429b4c155b168 2023-03-11 22:55:36,813 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,1,1678575335623.b1b55df2e1201b31717429b4c155b168.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-11 22:55:36,813 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for b1b55df2e1201b31717429b4c155b168 2023-03-11 22:55:36,813 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for b1b55df2e1201b31717429b4c155b168 2023-03-11 22:55:36,833 INFO [StoreOpener-b1b55df2e1201b31717429b4c155b168-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region b1b55df2e1201b31717429b4c155b168 2023-03-11 22:55:36,835 DEBUG [StoreOpener-b1b55df2e1201b31717429b4c155b168-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/b1b55df2e1201b31717429b4c155b168/family1 2023-03-11 22:55:36,835 DEBUG [StoreOpener-b1b55df2e1201b31717429b4c155b168-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/b1b55df2e1201b31717429b4c155b168/family1 2023-03-11 22:55:36,835 INFO [StoreOpener-b1b55df2e1201b31717429b4c155b168-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b1b55df2e1201b31717429b4c155b168 columnFamilyName family1 2023-03-11 22:55:36,836 INFO [StoreOpener-b1b55df2e1201b31717429b4c155b168-1] regionserver.HStore(310): Store=b1b55df2e1201b31717429b4c155b168/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-11 22:55:36,836 INFO [StoreOpener-b1b55df2e1201b31717429b4c155b168-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region b1b55df2e1201b31717429b4c155b168 2023-03-11 22:55:36,837 DEBUG [StoreOpener-b1b55df2e1201b31717429b4c155b168-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/b1b55df2e1201b31717429b4c155b168/family2 2023-03-11 22:55:36,837 DEBUG [StoreOpener-b1b55df2e1201b31717429b4c155b168-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/b1b55df2e1201b31717429b4c155b168/family2 2023-03-11 22:55:36,837 INFO [StoreOpener-b1b55df2e1201b31717429b4c155b168-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b1b55df2e1201b31717429b4c155b168 columnFamilyName family2 2023-03-11 22:55:36,838 INFO [StoreOpener-b1b55df2e1201b31717429b4c155b168-1] regionserver.HStore(310): Store=b1b55df2e1201b31717429b4c155b168/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-11 22:55:36,839 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/b1b55df2e1201b31717429b4c155b168 2023-03-11 22:55:36,839 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/b1b55df2e1201b31717429b4c155b168 2023-03-11 22:55:36,840 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-11 22:55:36,841 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for b1b55df2e1201b31717429b4c155b168 2023-03-11 22:55:36,842 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/b1b55df2e1201b31717429b4c155b168/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-11 22:55:36,842 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened b1b55df2e1201b31717429b4c155b168; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60361926, jitterRate=-0.10053721070289612}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-11 22:55:36,842 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for b1b55df2e1201b31717429b4c155b168: 2023-03-11 22:55:36,842 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionFromAdmin,1,1678575335623.b1b55df2e1201b31717429b4c155b168., pid=121, masterSystemTime=1678575336808 2023-03-11 22:55:36,844 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionFromAdmin,1,1678575335623.b1b55df2e1201b31717429b4c155b168. 2023-03-11 22:55:36,844 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionFromAdmin,1,1678575335623.b1b55df2e1201b31717429b4c155b168. 2023-03-11 22:55:36,844 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionFromAdmin,,1678575335623.234c190ff73b29a4f3c5e6a6e630633f. 2023-03-11 22:55:36,844 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 234c190ff73b29a4f3c5e6a6e630633f, NAME => 'testMajorCompactionFromAdmin,,1678575335623.234c190ff73b29a4f3c5e6a6e630633f.', STARTKEY => '', ENDKEY => '1'} 2023-03-11 22:55:36,844 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=b1b55df2e1201b31717429b4c155b168, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:36,844 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin 234c190ff73b29a4f3c5e6a6e630633f 2023-03-11 22:55:36,844 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,1,1678575335623.b1b55df2e1201b31717429b4c155b168.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1678575336844"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1678575336844"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678575336844"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678575336844"}]},"ts":"1678575336844"} 2023-03-11 22:55:36,844 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,,1678575335623.234c190ff73b29a4f3c5e6a6e630633f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-11 22:55:36,844 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 234c190ff73b29a4f3c5e6a6e630633f 2023-03-11 22:55:36,844 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 234c190ff73b29a4f3c5e6a6e630633f 2023-03-11 22:55:36,847 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=121, resume processing ppid=118 2023-03-11 22:55:36,847 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=121, ppid=118, state=SUCCESS; OpenRegionProcedure b1b55df2e1201b31717429b4c155b168, server=jenkins-hbase20.apache.org,41843,1678575183185 in 189 msec 2023-03-11 22:55:36,848 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=b1b55df2e1201b31717429b4c155b168, ASSIGN in 353 msec 2023-03-11 22:55:36,863 INFO [StoreOpener-234c190ff73b29a4f3c5e6a6e630633f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 234c190ff73b29a4f3c5e6a6e630633f 2023-03-11 22:55:36,864 DEBUG [StoreOpener-234c190ff73b29a4f3c5e6a6e630633f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/234c190ff73b29a4f3c5e6a6e630633f/family1 2023-03-11 22:55:36,865 DEBUG [StoreOpener-234c190ff73b29a4f3c5e6a6e630633f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/234c190ff73b29a4f3c5e6a6e630633f/family1 2023-03-11 22:55:36,865 INFO [StoreOpener-234c190ff73b29a4f3c5e6a6e630633f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 234c190ff73b29a4f3c5e6a6e630633f columnFamilyName family1 2023-03-11 22:55:36,865 INFO [StoreOpener-234c190ff73b29a4f3c5e6a6e630633f-1] regionserver.HStore(310): Store=234c190ff73b29a4f3c5e6a6e630633f/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-11 22:55:36,866 INFO [StoreOpener-234c190ff73b29a4f3c5e6a6e630633f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 234c190ff73b29a4f3c5e6a6e630633f 2023-03-11 22:55:36,867 DEBUG [StoreOpener-234c190ff73b29a4f3c5e6a6e630633f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/234c190ff73b29a4f3c5e6a6e630633f/family2 2023-03-11 22:55:36,867 DEBUG [StoreOpener-234c190ff73b29a4f3c5e6a6e630633f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/234c190ff73b29a4f3c5e6a6e630633f/family2 2023-03-11 22:55:36,867 INFO [StoreOpener-234c190ff73b29a4f3c5e6a6e630633f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 234c190ff73b29a4f3c5e6a6e630633f columnFamilyName family2 2023-03-11 22:55:36,867 INFO [StoreOpener-234c190ff73b29a4f3c5e6a6e630633f-1] regionserver.HStore(310): Store=234c190ff73b29a4f3c5e6a6e630633f/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-11 22:55:36,868 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/234c190ff73b29a4f3c5e6a6e630633f 2023-03-11 22:55:36,868 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/234c190ff73b29a4f3c5e6a6e630633f 2023-03-11 22:55:36,869 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-11 22:55:36,870 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 234c190ff73b29a4f3c5e6a6e630633f 2023-03-11 22:55:36,871 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/234c190ff73b29a4f3c5e6a6e630633f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-11 22:55:36,871 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 234c190ff73b29a4f3c5e6a6e630633f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59929791, jitterRate=-0.10697652399539948}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-11 22:55:36,871 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 234c190ff73b29a4f3c5e6a6e630633f: 2023-03-11 22:55:36,872 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionFromAdmin,,1678575335623.234c190ff73b29a4f3c5e6a6e630633f., pid=122, masterSystemTime=1678575336808 2023-03-11 22:55:36,873 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionFromAdmin,,1678575335623.234c190ff73b29a4f3c5e6a6e630633f. 2023-03-11 22:55:36,873 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionFromAdmin,,1678575335623.234c190ff73b29a4f3c5e6a6e630633f. 2023-03-11 22:55:36,873 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionFromAdmin,2,1678575335623.1b0a50d6be32f97a1a81d7fd32d7f47b. 2023-03-11 22:55:36,873 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1b0a50d6be32f97a1a81d7fd32d7f47b, NAME => 'testMajorCompactionFromAdmin,2,1678575335623.1b0a50d6be32f97a1a81d7fd32d7f47b.', STARTKEY => '2', ENDKEY => ''} 2023-03-11 22:55:36,873 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=117 updating hbase:meta row=234c190ff73b29a4f3c5e6a6e630633f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:36,873 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin 1b0a50d6be32f97a1a81d7fd32d7f47b 2023-03-11 22:55:36,873 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,,1678575335623.234c190ff73b29a4f3c5e6a6e630633f.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1678575336873"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1678575336873"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678575336873"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678575336873"}]},"ts":"1678575336873"} 2023-03-11 22:55:36,873 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,2,1678575335623.1b0a50d6be32f97a1a81d7fd32d7f47b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-11 22:55:36,873 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 1b0a50d6be32f97a1a81d7fd32d7f47b 2023-03-11 22:55:36,873 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 1b0a50d6be32f97a1a81d7fd32d7f47b 2023-03-11 22:55:36,875 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=122, resume processing ppid=117 2023-03-11 22:55:36,875 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=122, ppid=117, state=SUCCESS; OpenRegionProcedure 234c190ff73b29a4f3c5e6a6e630633f, server=jenkins-hbase20.apache.org,41843,1678575183185 in 216 msec 2023-03-11 22:55:36,876 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=234c190ff73b29a4f3c5e6a6e630633f, ASSIGN in 381 msec 2023-03-11 22:55:36,891 INFO [StoreOpener-1b0a50d6be32f97a1a81d7fd32d7f47b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 1b0a50d6be32f97a1a81d7fd32d7f47b 2023-03-11 22:55:36,892 DEBUG [StoreOpener-1b0a50d6be32f97a1a81d7fd32d7f47b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/1b0a50d6be32f97a1a81d7fd32d7f47b/family1 2023-03-11 22:55:36,892 DEBUG [StoreOpener-1b0a50d6be32f97a1a81d7fd32d7f47b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/1b0a50d6be32f97a1a81d7fd32d7f47b/family1 2023-03-11 22:55:36,893 INFO [StoreOpener-1b0a50d6be32f97a1a81d7fd32d7f47b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1b0a50d6be32f97a1a81d7fd32d7f47b columnFamilyName family1 2023-03-11 22:55:36,893 INFO [StoreOpener-1b0a50d6be32f97a1a81d7fd32d7f47b-1] regionserver.HStore(310): Store=1b0a50d6be32f97a1a81d7fd32d7f47b/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-11 22:55:36,893 INFO [StoreOpener-1b0a50d6be32f97a1a81d7fd32d7f47b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 1b0a50d6be32f97a1a81d7fd32d7f47b 2023-03-11 22:55:36,894 DEBUG [StoreOpener-1b0a50d6be32f97a1a81d7fd32d7f47b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/1b0a50d6be32f97a1a81d7fd32d7f47b/family2 2023-03-11 22:55:36,895 DEBUG [StoreOpener-1b0a50d6be32f97a1a81d7fd32d7f47b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/1b0a50d6be32f97a1a81d7fd32d7f47b/family2 2023-03-11 22:55:36,895 INFO [StoreOpener-1b0a50d6be32f97a1a81d7fd32d7f47b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1b0a50d6be32f97a1a81d7fd32d7f47b columnFamilyName family2 2023-03-11 22:55:36,895 INFO [StoreOpener-1b0a50d6be32f97a1a81d7fd32d7f47b-1] regionserver.HStore(310): Store=1b0a50d6be32f97a1a81d7fd32d7f47b/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-11 22:55:36,896 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/1b0a50d6be32f97a1a81d7fd32d7f47b 2023-03-11 22:55:36,896 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/1b0a50d6be32f97a1a81d7fd32d7f47b 2023-03-11 22:55:36,897 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-11 22:55:36,898 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 1b0a50d6be32f97a1a81d7fd32d7f47b 2023-03-11 22:55:36,899 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/1b0a50d6be32f97a1a81d7fd32d7f47b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-11 22:55:36,899 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 1b0a50d6be32f97a1a81d7fd32d7f47b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69921268, jitterRate=0.041908085346221924}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-11 22:55:36,899 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 1b0a50d6be32f97a1a81d7fd32d7f47b: 2023-03-11 22:55:36,900 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionFromAdmin,2,1678575335623.1b0a50d6be32f97a1a81d7fd32d7f47b., pid=120, masterSystemTime=1678575336808 2023-03-11 22:55:36,901 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionFromAdmin,2,1678575335623.1b0a50d6be32f97a1a81d7fd32d7f47b. 2023-03-11 22:55:36,901 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionFromAdmin,2,1678575335623.1b0a50d6be32f97a1a81d7fd32d7f47b. 2023-03-11 22:55:36,901 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=119 updating hbase:meta row=1b0a50d6be32f97a1a81d7fd32d7f47b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:36,901 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,2,1678575335623.1b0a50d6be32f97a1a81d7fd32d7f47b.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1678575336901"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1678575336901"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678575336901"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678575336901"}]},"ts":"1678575336901"} 2023-03-11 22:55:36,903 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=120, resume processing ppid=119 2023-03-11 22:55:36,904 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=120, ppid=119, state=SUCCESS; OpenRegionProcedure 1b0a50d6be32f97a1a81d7fd32d7f47b, server=jenkins-hbase20.apache.org,41843,1678575183185 in 248 msec 2023-03-11 22:55:36,905 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=119, resume processing ppid=116 2023-03-11 22:55:36,905 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=119, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=1b0a50d6be32f97a1a81d7fd32d7f47b, ASSIGN in 410 msec 2023-03-11 22:55:36,905 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-11 22:55:36,905 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionFromAdmin","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678575336905"}]},"ts":"1678575336905"} 2023-03-11 22:55:36,906 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionFromAdmin, state=ENABLED in hbase:meta 2023-03-11 22:55:36,909 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_POST_OPERATION 2023-03-11 22:55:36,910 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=116, state=SUCCESS; CreateTableProcedure table=testMajorCompactionFromAdmin in 1.2530 sec 2023-03-11 22:55:37,766 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-03-11 22:55:37,767 INFO [Listener at localhost.localdomain/41563] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionFromAdmin, procId: 116 completed 2023-03-11 22:55:37,773 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1678575335623.234c190ff73b29a4f3c5e6a6e630633f. with WAL disabled. Data may be lost in the event of a crash. 2023-03-11 22:55:37,773 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1678575335623.b1b55df2e1201b31717429b4c155b168. with WAL disabled. Data may be lost in the event of a crash. 2023-03-11 22:55:37,773 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1678575335623.1b0a50d6be32f97a1a81d7fd32d7f47b. with WAL disabled. Data may be lost in the event of a crash. 2023-03-11 22:55:37,775 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-11 22:55:37,777 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-03-11 22:55:37,777 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-03-11 22:55:37,777 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:55:37,777 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-03-11 22:55:37,777 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-03-11 22:55:37,778 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-11 22:55:37,778 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-11 22:55:37,778 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:55:37,778 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:37,778 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:55:37,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:55:37,778 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:37,779 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 22:55:37,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-11 22:55:37,779 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-11 22:55:37,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 22:55:37,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-11 22:55:37,779 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-03-11 22:55:37,779 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-03-11 22:55:37,779 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-03-11 22:55:37,779 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:55:37,779 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-03-11 22:55:37,779 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1678575335623.1b0a50d6be32f97a1a81d7fd32d7f47b. 2023-03-11 22:55:37,779 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1678575335623.234c190ff73b29a4f3c5e6a6e630633f. 2023-03-11 22:55:37,779 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1678575335623.234c190ff73b29a4f3c5e6a6e630633f. started... 2023-03-11 22:55:37,779 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1678575335623.1b0a50d6be32f97a1a81d7fd32d7f47b. started... 2023-03-11 22:55:37,783 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-11 22:55:37,783 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 234c190ff73b29a4f3c5e6a6e630633f 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-03-11 22:55:37,783 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 22:55:37,783 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1b0a50d6be32f97a1a81d7fd32d7f47b 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-03-11 22:55:37,783 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1678575335623.b1b55df2e1201b31717429b4c155b168. 2023-03-11 22:55:37,784 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1678575335623.b1b55df2e1201b31717429b4c155b168. started... 2023-03-11 22:55:37,786 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing b1b55df2e1201b31717429b4c155b168 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-03-11 22:55:38,241 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230311394991127d564e59b0e4cdff655d0432 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230311394991127d564e59b0e4cdff655d0432 2023-03-11 22:55:38,249 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230311dd80d5d9efea46968347b44fb0cbd549 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230311dd80d5d9efea46968347b44fb0cbd549 2023-03-11 22:55:38,249 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230311c49813ad3aaf4c71af35157984d87b7b to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230311c49813ad3aaf4c71af35157984d87b7b 2023-03-11 22:55:38,266 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/234c190ff73b29a4f3c5e6a6e630633f/.tmp/family1/2c8bec891dc34de795cf2d6eabe21d0d 2023-03-11 22:55:38,660 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/1b0a50d6be32f97a1a81d7fd32d7f47b/.tmp/family1/821ee200bea44a06a0ff93520beaf364 2023-03-11 22:55:38,667 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/b1b55df2e1201b31717429b4c155b168/.tmp/family1/e8cc24be030e4f718f9f980653ad1f17 2023-03-11 22:55:38,693 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303112095595da50a43b4a07a04db67ab4ff4 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e202303112095595da50a43b4a07a04db67ab4ff4 2023-03-11 22:55:39,096 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/234c190ff73b29a4f3c5e6a6e630633f/.tmp/family2/c4141e7a55b4465390d3c603afe0689a 2023-03-11 22:55:39,098 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023031146e260d0d19e4c49870b7d5e63f6dd61 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b2023031146e260d0d19e4c49870b7d5e63f6dd61 2023-03-11 22:55:39,098 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230311fdbdd43e210d458aae16c0375ab81196 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20230311fdbdd43e210d458aae16c0375ab81196 2023-03-11 22:55:39,104 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/234c190ff73b29a4f3c5e6a6e630633f/.tmp/family1/2c8bec891dc34de795cf2d6eabe21d0d as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/234c190ff73b29a4f3c5e6a6e630633f/family1/2c8bec891dc34de795cf2d6eabe21d0d 2023-03-11 22:55:39,133 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/234c190ff73b29a4f3c5e6a6e630633f/family1/2c8bec891dc34de795cf2d6eabe21d0d, entries=4, sequenceid=5, filesize=5.5 K 2023-03-11 22:55:39,134 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/234c190ff73b29a4f3c5e6a6e630633f/.tmp/family2/c4141e7a55b4465390d3c603afe0689a as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/234c190ff73b29a4f3c5e6a6e630633f/family2/c4141e7a55b4465390d3c603afe0689a 2023-03-11 22:55:39,138 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/234c190ff73b29a4f3c5e6a6e630633f/family2/c4141e7a55b4465390d3c603afe0689a, entries=2, sequenceid=5, filesize=5.1 K 2023-03-11 22:55:39,138 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 234c190ff73b29a4f3c5e6a6e630633f in 1355ms, sequenceid=5, compaction requested=false 2023-03-11 22:55:39,139 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionFromAdmin' 2023-03-11 22:55:39,139 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 234c190ff73b29a4f3c5e6a6e630633f: 2023-03-11 22:55:39,139 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1678575335623.234c190ff73b29a4f3c5e6a6e630633f. 2023-03-11 22:55:39,139 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-11 22:55:39,507 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/b1b55df2e1201b31717429b4c155b168/.tmp/family2/f71f71c639724d0ca92784d052c94abb 2023-03-11 22:55:39,507 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/1b0a50d6be32f97a1a81d7fd32d7f47b/.tmp/family2/3e7cb307c16846be914764d02bc44667 2023-03-11 22:55:39,511 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/1b0a50d6be32f97a1a81d7fd32d7f47b/.tmp/family1/821ee200bea44a06a0ff93520beaf364 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/1b0a50d6be32f97a1a81d7fd32d7f47b/family1/821ee200bea44a06a0ff93520beaf364 2023-03-11 22:55:39,511 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/b1b55df2e1201b31717429b4c155b168/.tmp/family1/e8cc24be030e4f718f9f980653ad1f17 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/b1b55df2e1201b31717429b4c155b168/family1/e8cc24be030e4f718f9f980653ad1f17 2023-03-11 22:55:39,534 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/b1b55df2e1201b31717429b4c155b168/family1/e8cc24be030e4f718f9f980653ad1f17, entries=4, sequenceid=5, filesize=5.5 K 2023-03-11 22:55:39,535 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/b1b55df2e1201b31717429b4c155b168/.tmp/family2/f71f71c639724d0ca92784d052c94abb as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/b1b55df2e1201b31717429b4c155b168/family2/f71f71c639724d0ca92784d052c94abb 2023-03-11 22:55:39,537 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/1b0a50d6be32f97a1a81d7fd32d7f47b/family1/821ee200bea44a06a0ff93520beaf364, entries=4, sequenceid=5, filesize=5.5 K 2023-03-11 22:55:39,537 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/1b0a50d6be32f97a1a81d7fd32d7f47b/.tmp/family2/3e7cb307c16846be914764d02bc44667 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/1b0a50d6be32f97a1a81d7fd32d7f47b/family2/3e7cb307c16846be914764d02bc44667 2023-03-11 22:55:39,546 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/b1b55df2e1201b31717429b4c155b168/family2/f71f71c639724d0ca92784d052c94abb, entries=2, sequenceid=5, filesize=5.1 K 2023-03-11 22:55:39,546 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for b1b55df2e1201b31717429b4c155b168 in 1760ms, sequenceid=5, compaction requested=false 2023-03-11 22:55:39,547 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for b1b55df2e1201b31717429b4c155b168: 2023-03-11 22:55:39,547 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1678575335623.b1b55df2e1201b31717429b4c155b168. 2023-03-11 22:55:39,547 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-11 22:55:39,551 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/1b0a50d6be32f97a1a81d7fd32d7f47b/family2/3e7cb307c16846be914764d02bc44667, entries=2, sequenceid=5, filesize=5.1 K 2023-03-11 22:55:39,552 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 1b0a50d6be32f97a1a81d7fd32d7f47b in 1769ms, sequenceid=5, compaction requested=false 2023-03-11 22:55:39,552 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1b0a50d6be32f97a1a81d7fd32d7f47b: 2023-03-11 22:55:39,552 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1678575335623.1b0a50d6be32f97a1a81d7fd32d7f47b. 2023-03-11 22:55:39,552 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-11 22:55:39,552 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-11 22:55:39,552 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:39,552 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-03-11 22:55:39,552 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-03-11 22:55:39,553 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-11 22:55:39,553 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:39,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:39,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:55:39,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:55:39,553 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-11 22:55:39,553 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 22:55:39,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:55:39,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:55:39,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-11 22:55:39,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:39,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:55:39,554 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-03-11 22:55:39,554 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@483e52a6[Count = 0] remaining members to acquire global barrier 2023-03-11 22:55:39,554 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-03-11 22:55:39,554 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-11 22:55:39,555 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-11 22:55:39,555 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-11 22:55:39,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-11 22:55:39,555 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-03-11 22:55:39,555 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-03-11 22:55:39,555 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase20.apache.org,41843,1678575183185' in zk 2023-03-11 22:55:39,555 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:39,555 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 22:55:39,556 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:39,556 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-03-11 22:55:39,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:39,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:55:39,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:55:39,556 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:55:39,556 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-03-11 22:55:39,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:55:39,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:55:39,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-11 22:55:39,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:39,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:55:39,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-11 22:55:39,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:39,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase20.apache.org,41843,1678575183185': 2023-03-11 22:55:39,558 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-03-11 22:55:39,558 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-03-11 22:55:39,558 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 22:55:39,558 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 22:55:39,558 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-03-11 22:55:39,558 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 22:55:39,559 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-11 22:55:39,559 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-11 22:55:39,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-11 22:55:39,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:55:39,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:55:39,559 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-11 22:55:39,559 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:55:39,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-11 22:55:39,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:55:39,559 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:39,559 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:55:39,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:55:39,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-11 22:55:39,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-11 22:55:39,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:55:39,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-11 22:55:39,560 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:39,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:39,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:55:39,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-11 22:55:39,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:39,561 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:55:39,561 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:55:39,561 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:55:39,561 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-03-11 22:55:39,561 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 22:55:39,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:55:39,561 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:39,561 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-03-11 22:55:39,561 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:55:39,561 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-11 22:55:39,561 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-03-11 22:55:39,561 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-11 22:55:39,561 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:39,561 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 22:55:39,562 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:55:39,561 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-11 22:55:39,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:55:39,562 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-11 22:55:39,562 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-11 22:55:39,662 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 22:55:39,663 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 22:55:39,664 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1678575335623.234c190ff73b29a4f3c5e6a6e630633f. with WAL disabled. Data may be lost in the event of a crash. 2023-03-11 22:55:39,664 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1678575335623.b1b55df2e1201b31717429b4c155b168. with WAL disabled. Data may be lost in the event of a crash. 2023-03-11 22:55:39,664 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1678575335623.1b0a50d6be32f97a1a81d7fd32d7f47b. with WAL disabled. Data may be lost in the event of a crash. 2023-03-11 22:55:39,667 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-11 22:55:39,668 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-03-11 22:55:39,668 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-03-11 22:55:39,668 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-03-11 22:55:39,669 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:55:39,669 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-03-11 22:55:39,669 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-03-11 22:55:39,669 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-11 22:55:39,669 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-11 22:55:39,670 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:55:39,670 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:39,670 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:55:39,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:55:39,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-11 22:55:39,670 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:39,670 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 22:55:39,670 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-11 22:55:39,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 22:55:39,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-11 22:55:39,670 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-03-11 22:55:39,671 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-03-11 22:55:39,671 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-03-11 22:55:39,671 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-03-11 22:55:39,671 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:55:39,671 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-03-11 22:55:39,671 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1678575335623.1b0a50d6be32f97a1a81d7fd32d7f47b. 2023-03-11 22:55:39,671 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-11 22:55:39,671 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1678575335623.b1b55df2e1201b31717429b4c155b168. 2023-03-11 22:55:39,671 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 22:55:39,671 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1678575335623.1b0a50d6be32f97a1a81d7fd32d7f47b. started... 2023-03-11 22:55:39,671 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1678575335623.234c190ff73b29a4f3c5e6a6e630633f. 2023-03-11 22:55:39,671 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1678575335623.b1b55df2e1201b31717429b4c155b168. started... 2023-03-11 22:55:39,671 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1678575335623.234c190ff73b29a4f3c5e6a6e630633f. started... 2023-03-11 22:55:39,671 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1b0a50d6be32f97a1a81d7fd32d7f47b 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-03-11 22:55:39,671 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 234c190ff73b29a4f3c5e6a6e630633f 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-03-11 22:55:39,671 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing b1b55df2e1201b31717429b4c155b168 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-03-11 22:55:39,711 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303110211e401220e48b2a0a77496dfe9eaaf to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202303110211e401220e48b2a0a77496dfe9eaaf 2023-03-11 22:55:39,724 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/1b0a50d6be32f97a1a81d7fd32d7f47b/.tmp/family1/12f16bcd84b3442d9ccf6bdafdf4cdc1 2023-03-11 22:55:40,112 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230311f3dc8f91f52f4da283088dba727c68ce to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230311f3dc8f91f52f4da283088dba727c68ce 2023-03-11 22:55:40,121 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303117b1d19bfe59d43128d70fd1e2a92a524 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202303117b1d19bfe59d43128d70fd1e2a92a524 2023-03-11 22:55:40,164 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-11 22:55:40,164 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2b3a16f0 to 127.0.0.1:51815 2023-03-11 22:55:40,164 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-11 22:55:40,165 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-11 22:55:40,165 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x61b3f1b5 to 127.0.0.1:51815 2023-03-11 22:55:40,165 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-11 22:55:40,174 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230311573d1193a119436888ba2b48cf578ff2 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20230311573d1193a119436888ba2b48cf578ff2 2023-03-11 22:55:40,184 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/234c190ff73b29a4f3c5e6a6e630633f/.tmp/family1/b1b58735286d411f8ddd28ca190e2098 2023-03-11 22:55:40,203 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/1b0a50d6be32f97a1a81d7fd32d7f47b/.tmp/family2/8ab0fb40736644bfb244678b2ec26ec0 2023-03-11 22:55:40,222 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/1b0a50d6be32f97a1a81d7fd32d7f47b/.tmp/family1/12f16bcd84b3442d9ccf6bdafdf4cdc1 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/1b0a50d6be32f97a1a81d7fd32d7f47b/family1/12f16bcd84b3442d9ccf6bdafdf4cdc1 2023-03-11 22:55:40,239 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230311eb614ae4ab034e84b3a5d1d9c603ef42 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20230311eb614ae4ab034e84b3a5d1d9c603ef42 2023-03-11 22:55:40,257 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/1b0a50d6be32f97a1a81d7fd32d7f47b/family1/12f16bcd84b3442d9ccf6bdafdf4cdc1, entries=4, sequenceid=9, filesize=5.5 K 2023-03-11 22:55:40,258 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/1b0a50d6be32f97a1a81d7fd32d7f47b/.tmp/family2/8ab0fb40736644bfb244678b2ec26ec0 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/1b0a50d6be32f97a1a81d7fd32d7f47b/family2/8ab0fb40736644bfb244678b2ec26ec0 2023-03-11 22:55:40,261 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/1b0a50d6be32f97a1a81d7fd32d7f47b/family2/8ab0fb40736644bfb244678b2ec26ec0, entries=2, sequenceid=9, filesize=5.1 K 2023-03-11 22:55:40,262 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 1b0a50d6be32f97a1a81d7fd32d7f47b in 591ms, sequenceid=9, compaction requested=false 2023-03-11 22:55:40,262 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1b0a50d6be32f97a1a81d7fd32d7f47b: 2023-03-11 22:55:40,262 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1678575335623.1b0a50d6be32f97a1a81d7fd32d7f47b. 2023-03-11 22:55:40,262 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-11 22:55:40,571 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/b1b55df2e1201b31717429b4c155b168/.tmp/family1/c476f16414304318bb8aa202a7714f97 2023-03-11 22:55:40,652 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/234c190ff73b29a4f3c5e6a6e630633f/.tmp/family2/29d090ea104049679d9ab079cad5fd40 2023-03-11 22:55:40,656 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/234c190ff73b29a4f3c5e6a6e630633f/.tmp/family1/b1b58735286d411f8ddd28ca190e2098 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/234c190ff73b29a4f3c5e6a6e630633f/family1/b1b58735286d411f8ddd28ca190e2098 2023-03-11 22:55:40,682 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/234c190ff73b29a4f3c5e6a6e630633f/family1/b1b58735286d411f8ddd28ca190e2098, entries=4, sequenceid=9, filesize=5.5 K 2023-03-11 22:55:40,683 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/234c190ff73b29a4f3c5e6a6e630633f/.tmp/family2/29d090ea104049679d9ab079cad5fd40 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/234c190ff73b29a4f3c5e6a6e630633f/family2/29d090ea104049679d9ab079cad5fd40 2023-03-11 22:55:40,686 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/234c190ff73b29a4f3c5e6a6e630633f/family2/29d090ea104049679d9ab079cad5fd40, entries=2, sequenceid=9, filesize=5.1 K 2023-03-11 22:55:40,687 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 234c190ff73b29a4f3c5e6a6e630633f in 1016ms, sequenceid=9, compaction requested=false 2023-03-11 22:55:40,687 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 234c190ff73b29a4f3c5e6a6e630633f: 2023-03-11 22:55:40,687 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1678575335623.234c190ff73b29a4f3c5e6a6e630633f. 2023-03-11 22:55:40,687 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-11 22:55:41,002 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202303112635333022cc461387a52dabfefd9381 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b202303112635333022cc461387a52dabfefd9381 2023-03-11 22:55:41,407 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/b1b55df2e1201b31717429b4c155b168/.tmp/family2/5fbc083fc69e4551978b0b9c1f01bd34 2023-03-11 22:55:41,410 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/b1b55df2e1201b31717429b4c155b168/.tmp/family1/c476f16414304318bb8aa202a7714f97 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/b1b55df2e1201b31717429b4c155b168/family1/c476f16414304318bb8aa202a7714f97 2023-03-11 22:55:41,432 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/b1b55df2e1201b31717429b4c155b168/family1/c476f16414304318bb8aa202a7714f97, entries=4, sequenceid=9, filesize=5.5 K 2023-03-11 22:55:41,433 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/b1b55df2e1201b31717429b4c155b168/.tmp/family2/5fbc083fc69e4551978b0b9c1f01bd34 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/b1b55df2e1201b31717429b4c155b168/family2/5fbc083fc69e4551978b0b9c1f01bd34 2023-03-11 22:55:41,437 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/b1b55df2e1201b31717429b4c155b168/family2/5fbc083fc69e4551978b0b9c1f01bd34, entries=2, sequenceid=9, filesize=5.1 K 2023-03-11 22:55:41,437 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for b1b55df2e1201b31717429b4c155b168 in 1766ms, sequenceid=9, compaction requested=false 2023-03-11 22:55:41,437 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for b1b55df2e1201b31717429b4c155b168: 2023-03-11 22:55:41,437 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1678575335623.b1b55df2e1201b31717429b4c155b168. 2023-03-11 22:55:41,437 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-11 22:55:41,437 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-11 22:55:41,437 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:41,438 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-03-11 22:55:41,438 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-03-11 22:55:41,439 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-11 22:55:41,439 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:41,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:41,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:55:41,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:55:41,439 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-11 22:55:41,439 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 22:55:41,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:55:41,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:55:41,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-11 22:55:41,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:41,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:55:41,440 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-03-11 22:55:41,440 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5d0a176e[Count = 0] remaining members to acquire global barrier 2023-03-11 22:55:41,440 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-03-11 22:55:41,440 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-11 22:55:41,441 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-11 22:55:41,441 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-11 22:55:41,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-11 22:55:41,441 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-03-11 22:55:41,441 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-03-11 22:55:41,441 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:41,441 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 22:55:41,441 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase20.apache.org,41843,1678575183185' in zk 2023-03-11 22:55:41,442 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-03-11 22:55:41,442 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:41,442 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:55:41,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:41,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:55:41,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:55:41,442 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-03-11 22:55:41,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:55:41,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:55:41,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-11 22:55:41,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:41,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:55:41,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-11 22:55:41,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:41,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase20.apache.org,41843,1678575183185': 2023-03-11 22:55:41,444 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-03-11 22:55:41,444 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-03-11 22:55:41,444 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 22:55:41,444 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 22:55:41,444 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-03-11 22:55:41,444 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 22:55:41,445 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-11 22:55:41,445 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:55:41,445 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-11 22:55:41,445 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-11 22:55:41,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-11 22:55:41,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-11 22:55:41,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:55:41,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:55:41,445 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:55:41,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:55:41,445 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:41,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:55:41,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-11 22:55:41,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-11 22:55:41,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:55:41,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-11 22:55:41,446 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:41,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:41,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:55:41,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-11 22:55:41,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:41,447 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:41,447 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-11 22:55:41,447 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:55:41,447 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-11 22:55:41,447 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:55:41,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:55:41,448 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:55:41,448 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:41,448 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-11 22:55:41,448 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:55:41,448 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-11 22:55:41,448 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-03-11 22:55:41,448 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:55:41,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:55:41,448 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 22:55:41,448 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-11 22:55:41,448 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-03-11 22:55:41,448 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-03-11 22:55:41,448 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 22:55:41,548 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 22:55:41,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 22:55:41,550 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1678575335623.234c190ff73b29a4f3c5e6a6e630633f. with WAL disabled. Data may be lost in the event of a crash. 2023-03-11 22:55:41,550 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1678575335623.b1b55df2e1201b31717429b4c155b168. with WAL disabled. Data may be lost in the event of a crash. 2023-03-11 22:55:41,550 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1678575335623.1b0a50d6be32f97a1a81d7fd32d7f47b. with WAL disabled. Data may be lost in the event of a crash. 2023-03-11 22:55:41,552 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-11 22:55:41,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-03-11 22:55:41,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-03-11 22:55:41,553 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-03-11 22:55:41,554 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:55:41,554 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-03-11 22:55:41,554 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-03-11 22:55:41,554 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-11 22:55:41,554 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-11 22:55:41,555 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:55:41,555 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:41,555 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:55:41,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:55:41,555 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:41,555 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 22:55:41,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-11 22:55:41,555 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-11 22:55:41,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 22:55:41,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-11 22:55:41,556 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-03-11 22:55:41,556 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-03-11 22:55:41,556 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-03-11 22:55:41,556 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-03-11 22:55:41,556 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:55:41,556 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-03-11 22:55:41,556 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1678575335623.1b0a50d6be32f97a1a81d7fd32d7f47b. 2023-03-11 22:55:41,556 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1678575335623.1b0a50d6be32f97a1a81d7fd32d7f47b. started... 2023-03-11 22:55:41,556 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1678575335623.234c190ff73b29a4f3c5e6a6e630633f. 2023-03-11 22:55:41,556 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1b0a50d6be32f97a1a81d7fd32d7f47b 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-03-11 22:55:41,556 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1678575335623.234c190ff73b29a4f3c5e6a6e630633f. started... 2023-03-11 22:55:41,556 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 234c190ff73b29a4f3c5e6a6e630633f 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-03-11 22:55:41,557 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-11 22:55:41,557 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 22:55:41,557 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1678575335623.b1b55df2e1201b31717429b4c155b168. 2023-03-11 22:55:41,557 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1678575335623.b1b55df2e1201b31717429b4c155b168. started... 2023-03-11 22:55:41,557 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing b1b55df2e1201b31717429b4c155b168 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-03-11 22:55:41,606 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023031174a1e0b8716246a59f23daf62a8bb655 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023031174a1e0b8716246a59f23daf62a8bb655 2023-03-11 22:55:42,010 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023031118a46bcd8ece4a02a5bc95bd48847132 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023031118a46bcd8ece4a02a5bc95bd48847132 2023-03-11 22:55:42,012 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230311d75c0872f31a49639a4e7de17c301992 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230311d75c0872f31a49639a4e7de17c301992 2023-03-11 22:55:42,019 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/b1b55df2e1201b31717429b4c155b168/.tmp/family1/253d3939a7044c21b7f9c2deff925e37 2023-03-11 22:55:42,034 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/234c190ff73b29a4f3c5e6a6e630633f/.tmp/family1/31084cc6a03e49ada023fcba7becb28b 2023-03-11 22:55:42,038 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/1b0a50d6be32f97a1a81d7fd32d7f47b/.tmp/family1/22bcac8e8e60435c9942ffe2d9a51779 2023-03-11 22:55:42,086 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202303116326a6afb1c54d0aaab55c1bbed833ac to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b202303116326a6afb1c54d0aaab55c1bbed833ac 2023-03-11 22:55:42,112 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230311ebd6a69a7cff4c42952e379d2c1d66f8 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20230311ebd6a69a7cff4c42952e379d2c1d66f8 2023-03-11 22:55:42,113 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/b1b55df2e1201b31717429b4c155b168/.tmp/family2/3f1a98da6eba4964a2860890e558ba16 2023-03-11 22:55:42,118 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/b1b55df2e1201b31717429b4c155b168/.tmp/family1/253d3939a7044c21b7f9c2deff925e37 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/b1b55df2e1201b31717429b4c155b168/family1/253d3939a7044c21b7f9c2deff925e37 2023-03-11 22:55:42,121 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023031141b404c38df5406fa60fb5a709c9bf03 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e2023031141b404c38df5406fa60fb5a709c9bf03 2023-03-11 22:55:42,150 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/b1b55df2e1201b31717429b4c155b168/family1/253d3939a7044c21b7f9c2deff925e37, entries=4, sequenceid=13, filesize=5.5 K 2023-03-11 22:55:42,151 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/b1b55df2e1201b31717429b4c155b168/.tmp/family2/3f1a98da6eba4964a2860890e558ba16 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/b1b55df2e1201b31717429b4c155b168/family2/3f1a98da6eba4964a2860890e558ba16 2023-03-11 22:55:42,155 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/b1b55df2e1201b31717429b4c155b168/family2/3f1a98da6eba4964a2860890e558ba16, entries=2, sequenceid=13, filesize=5.1 K 2023-03-11 22:55:42,155 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for b1b55df2e1201b31717429b4c155b168 in 598ms, sequenceid=13, compaction requested=true 2023-03-11 22:55:42,155 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for b1b55df2e1201b31717429b4c155b168: 2023-03-11 22:55:42,155 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1678575335623.b1b55df2e1201b31717429b4c155b168. 2023-03-11 22:55:42,155 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-11 22:55:42,344 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-11 22:55:42,535 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/1b0a50d6be32f97a1a81d7fd32d7f47b/.tmp/family2/6be6a80018154964bbb74f4627f0f181 2023-03-11 22:55:42,539 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/1b0a50d6be32f97a1a81d7fd32d7f47b/.tmp/family1/22bcac8e8e60435c9942ffe2d9a51779 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/1b0a50d6be32f97a1a81d7fd32d7f47b/family1/22bcac8e8e60435c9942ffe2d9a51779 2023-03-11 22:55:42,550 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/234c190ff73b29a4f3c5e6a6e630633f/.tmp/family2/5a13448e4ada443f8582e56235401844 2023-03-11 22:55:42,553 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/234c190ff73b29a4f3c5e6a6e630633f/.tmp/family1/31084cc6a03e49ada023fcba7becb28b as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/234c190ff73b29a4f3c5e6a6e630633f/family1/31084cc6a03e49ada023fcba7becb28b 2023-03-11 22:55:42,561 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/1b0a50d6be32f97a1a81d7fd32d7f47b/family1/22bcac8e8e60435c9942ffe2d9a51779, entries=4, sequenceid=13, filesize=5.5 K 2023-03-11 22:55:42,562 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/1b0a50d6be32f97a1a81d7fd32d7f47b/.tmp/family2/6be6a80018154964bbb74f4627f0f181 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/1b0a50d6be32f97a1a81d7fd32d7f47b/family2/6be6a80018154964bbb74f4627f0f181 2023-03-11 22:55:42,566 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/1b0a50d6be32f97a1a81d7fd32d7f47b/family2/6be6a80018154964bbb74f4627f0f181, entries=2, sequenceid=13, filesize=5.1 K 2023-03-11 22:55:42,566 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 1b0a50d6be32f97a1a81d7fd32d7f47b in 1010ms, sequenceid=13, compaction requested=true 2023-03-11 22:55:42,567 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1b0a50d6be32f97a1a81d7fd32d7f47b: 2023-03-11 22:55:42,567 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1678575335623.1b0a50d6be32f97a1a81d7fd32d7f47b. 2023-03-11 22:55:42,567 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-11 22:55:42,573 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/234c190ff73b29a4f3c5e6a6e630633f/family1/31084cc6a03e49ada023fcba7becb28b, entries=4, sequenceid=13, filesize=5.5 K 2023-03-11 22:55:42,573 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/234c190ff73b29a4f3c5e6a6e630633f/.tmp/family2/5a13448e4ada443f8582e56235401844 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/234c190ff73b29a4f3c5e6a6e630633f/family2/5a13448e4ada443f8582e56235401844 2023-03-11 22:55:42,576 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/234c190ff73b29a4f3c5e6a6e630633f/family2/5a13448e4ada443f8582e56235401844, entries=2, sequenceid=13, filesize=5.1 K 2023-03-11 22:55:42,577 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 234c190ff73b29a4f3c5e6a6e630633f in 1021ms, sequenceid=13, compaction requested=true 2023-03-11 22:55:42,577 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 234c190ff73b29a4f3c5e6a6e630633f: 2023-03-11 22:55:42,577 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1678575335623.234c190ff73b29a4f3c5e6a6e630633f. 2023-03-11 22:55:42,577 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-11 22:55:42,577 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-11 22:55:42,577 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:42,577 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-03-11 22:55:42,577 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-03-11 22:55:42,578 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-11 22:55:42,578 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:42,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:42,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:55:42,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:55:42,578 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-11 22:55:42,578 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 22:55:42,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:55:42,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:55:42,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-11 22:55:42,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:42,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:55:42,579 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-03-11 22:55:42,580 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@369cc9ac[Count = 0] remaining members to acquire global barrier 2023-03-11 22:55:42,580 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-03-11 22:55:42,580 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-11 22:55:42,580 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-11 22:55:42,580 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-11 22:55:42,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-11 22:55:42,580 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-03-11 22:55:42,580 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:42,580 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 22:55:42,580 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-03-11 22:55:42,580 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase20.apache.org,41843,1678575183185' in zk 2023-03-11 22:55:42,581 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:42,581 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-03-11 22:55:42,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:42,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:55:42,581 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:55:42,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:55:42,581 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-03-11 22:55:42,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:55:42,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:55:42,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-11 22:55:42,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:42,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:55:42,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-11 22:55:42,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:42,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase20.apache.org,41843,1678575183185': 2023-03-11 22:55:42,583 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-03-11 22:55:42,583 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-03-11 22:55:42,583 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 22:55:42,583 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 22:55:42,583 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-03-11 22:55:42,583 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 22:55:42,583 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-11 22:55:42,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-11 22:55:42,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:55:42,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:55:42,584 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-11 22:55:42,584 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:55:42,584 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-11 22:55:42,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-11 22:55:42,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:55:42,584 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:42,584 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:55:42,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:55:42,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-11 22:55:42,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-11 22:55:42,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:55:42,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-11 22:55:42,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:42,585 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:42,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:55:42,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-11 22:55:42,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:42,587 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:42,587 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-11 22:55:42,587 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:55:42,587 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-11 22:55:42,587 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:55:42,587 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:55:42,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:55:42,587 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:42,587 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-03-11 22:55:42,587 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 22:55:42,587 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:55:42,587 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:55:42,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:55:42,587 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-11 22:55:42,587 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-11 22:55:42,587 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-03-11 22:55:42,587 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-11 22:55:42,587 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 22:55:42,687 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 22:55:42,688 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 22:55:42,689 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1678575335623.234c190ff73b29a4f3c5e6a6e630633f. with WAL disabled. Data may be lost in the event of a crash. 2023-03-11 22:55:42,689 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1678575335623.b1b55df2e1201b31717429b4c155b168. with WAL disabled. Data may be lost in the event of a crash. 2023-03-11 22:55:42,690 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1678575335623.1b0a50d6be32f97a1a81d7fd32d7f47b. with WAL disabled. Data may be lost in the event of a crash. 2023-03-11 22:55:42,692 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-11 22:55:42,693 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-03-11 22:55:42,693 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-03-11 22:55:42,693 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-03-11 22:55:42,693 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:55:42,693 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-03-11 22:55:42,693 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-03-11 22:55:42,694 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-11 22:55:42,694 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-11 22:55:42,695 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:55:42,695 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:42,695 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:55:42,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:55:42,695 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:42,695 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 22:55:42,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-11 22:55:42,696 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-11 22:55:42,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 22:55:42,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-11 22:55:42,696 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-03-11 22:55:42,696 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-03-11 22:55:42,696 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-03-11 22:55:42,696 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-03-11 22:55:42,696 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:55:42,696 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-03-11 22:55:42,697 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1678575335623.1b0a50d6be32f97a1a81d7fd32d7f47b. 2023-03-11 22:55:42,697 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1678575335623.1b0a50d6be32f97a1a81d7fd32d7f47b. started... 2023-03-11 22:55:42,697 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-11 22:55:42,697 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 22:55:42,697 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1b0a50d6be32f97a1a81d7fd32d7f47b 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-03-11 22:55:42,697 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1678575335623.234c190ff73b29a4f3c5e6a6e630633f. 2023-03-11 22:55:42,697 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1678575335623.b1b55df2e1201b31717429b4c155b168. 2023-03-11 22:55:42,697 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1678575335623.234c190ff73b29a4f3c5e6a6e630633f. started... 2023-03-11 22:55:42,697 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1678575335623.b1b55df2e1201b31717429b4c155b168. started... 2023-03-11 22:55:42,697 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 234c190ff73b29a4f3c5e6a6e630633f 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-03-11 22:55:42,697 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing b1b55df2e1201b31717429b4c155b168 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-03-11 22:55:42,753 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230311294407e13a894698b3e44fc13835256c to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230311294407e13a894698b3e44fc13835256c 2023-03-11 22:55:43,148 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230311ad9f4cf547fb40c592e258a5e9d620a4 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230311ad9f4cf547fb40c592e258a5e9d620a4 2023-03-11 22:55:43,148 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303111301d108b05b4cedb47b35cf878b0eeb to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202303111301d108b05b4cedb47b35cf878b0eeb 2023-03-11 22:55:43,170 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/b1b55df2e1201b31717429b4c155b168/.tmp/family1/849dfb1d5ff84846a1123ca028c1d7e5 2023-03-11 22:55:43,568 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/1b0a50d6be32f97a1a81d7fd32d7f47b/.tmp/family1/2c5aafd1a8e34a2d8f2cff5675a258f5 2023-03-11 22:55:43,568 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/234c190ff73b29a4f3c5e6a6e630633f/.tmp/family1/addeabc6385d460e9ab46da812de3268 2023-03-11 22:55:43,604 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202303111d07b035349c4cc893f52b736dd58b73 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b202303111d07b035349c4cc893f52b736dd58b73 2023-03-11 22:55:44,009 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230311a9099056c8b84fb29ebf026034d4dabc to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20230311a9099056c8b84fb29ebf026034d4dabc 2023-03-11 22:55:44,009 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023031112044c638edb47508802f070b7c2f29c to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e2023031112044c638edb47508802f070b7c2f29c 2023-03-11 22:55:44,010 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/b1b55df2e1201b31717429b4c155b168/.tmp/family2/29d43dc05c4f4f5d8d51a6a120c52bb3 2023-03-11 22:55:44,015 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/234c190ff73b29a4f3c5e6a6e630633f/.tmp/family2/908dda519b5b4d77bd64d1e0a0c87e31 2023-03-11 22:55:44,015 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/b1b55df2e1201b31717429b4c155b168/.tmp/family1/849dfb1d5ff84846a1123ca028c1d7e5 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/b1b55df2e1201b31717429b4c155b168/family1/849dfb1d5ff84846a1123ca028c1d7e5 2023-03-11 22:55:44,022 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/234c190ff73b29a4f3c5e6a6e630633f/.tmp/family1/addeabc6385d460e9ab46da812de3268 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/234c190ff73b29a4f3c5e6a6e630633f/family1/addeabc6385d460e9ab46da812de3268 2023-03-11 22:55:44,042 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/b1b55df2e1201b31717429b4c155b168/family1/849dfb1d5ff84846a1123ca028c1d7e5, entries=4, sequenceid=17, filesize=5.5 K 2023-03-11 22:55:44,043 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/b1b55df2e1201b31717429b4c155b168/.tmp/family2/29d43dc05c4f4f5d8d51a6a120c52bb3 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/b1b55df2e1201b31717429b4c155b168/family2/29d43dc05c4f4f5d8d51a6a120c52bb3 2023-03-11 22:55:44,046 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/234c190ff73b29a4f3c5e6a6e630633f/family1/addeabc6385d460e9ab46da812de3268, entries=4, sequenceid=17, filesize=5.5 K 2023-03-11 22:55:44,047 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/234c190ff73b29a4f3c5e6a6e630633f/.tmp/family2/908dda519b5b4d77bd64d1e0a0c87e31 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/234c190ff73b29a4f3c5e6a6e630633f/family2/908dda519b5b4d77bd64d1e0a0c87e31 2023-03-11 22:55:44,048 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/b1b55df2e1201b31717429b4c155b168/family2/29d43dc05c4f4f5d8d51a6a120c52bb3, entries=2, sequenceid=17, filesize=5.1 K 2023-03-11 22:55:44,048 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for b1b55df2e1201b31717429b4c155b168 in 1351ms, sequenceid=17, compaction requested=true 2023-03-11 22:55:44,048 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for b1b55df2e1201b31717429b4c155b168: 2023-03-11 22:55:44,048 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1678575335623.b1b55df2e1201b31717429b4c155b168. 2023-03-11 22:55:44,049 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-11 22:55:44,051 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/234c190ff73b29a4f3c5e6a6e630633f/family2/908dda519b5b4d77bd64d1e0a0c87e31, entries=2, sequenceid=17, filesize=5.1 K 2023-03-11 22:55:44,052 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 234c190ff73b29a4f3c5e6a6e630633f in 1355ms, sequenceid=17, compaction requested=true 2023-03-11 22:55:44,052 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 234c190ff73b29a4f3c5e6a6e630633f: 2023-03-11 22:55:44,052 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1678575335623.234c190ff73b29a4f3c5e6a6e630633f. 2023-03-11 22:55:44,053 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-11 22:55:44,415 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/1b0a50d6be32f97a1a81d7fd32d7f47b/.tmp/family2/110df6b279a340f7a70e453f245c89db 2023-03-11 22:55:44,420 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/1b0a50d6be32f97a1a81d7fd32d7f47b/.tmp/family1/2c5aafd1a8e34a2d8f2cff5675a258f5 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/1b0a50d6be32f97a1a81d7fd32d7f47b/family1/2c5aafd1a8e34a2d8f2cff5675a258f5 2023-03-11 22:55:44,442 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/1b0a50d6be32f97a1a81d7fd32d7f47b/family1/2c5aafd1a8e34a2d8f2cff5675a258f5, entries=4, sequenceid=17, filesize=5.5 K 2023-03-11 22:55:44,442 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/1b0a50d6be32f97a1a81d7fd32d7f47b/.tmp/family2/110df6b279a340f7a70e453f245c89db as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/1b0a50d6be32f97a1a81d7fd32d7f47b/family2/110df6b279a340f7a70e453f245c89db 2023-03-11 22:55:44,446 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/1b0a50d6be32f97a1a81d7fd32d7f47b/family2/110df6b279a340f7a70e453f245c89db, entries=2, sequenceid=17, filesize=5.1 K 2023-03-11 22:55:44,446 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 1b0a50d6be32f97a1a81d7fd32d7f47b in 1749ms, sequenceid=17, compaction requested=true 2023-03-11 22:55:44,446 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1b0a50d6be32f97a1a81d7fd32d7f47b: 2023-03-11 22:55:44,446 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1678575335623.1b0a50d6be32f97a1a81d7fd32d7f47b. 2023-03-11 22:55:44,446 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-11 22:55:44,446 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-11 22:55:44,446 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:44,447 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-03-11 22:55:44,447 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-03-11 22:55:44,447 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-11 22:55:44,447 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:44,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:44,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:55:44,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:55:44,448 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-11 22:55:44,448 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 22:55:44,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:55:44,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:55:44,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-11 22:55:44,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:44,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:55:44,449 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-03-11 22:55:44,449 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@673f8b4f[Count = 0] remaining members to acquire global barrier 2023-03-11 22:55:44,449 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-03-11 22:55:44,449 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-11 22:55:44,450 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-11 22:55:44,450 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-11 22:55:44,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-11 22:55:44,450 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-03-11 22:55:44,450 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-03-11 22:55:44,450 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:44,450 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 22:55:44,450 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase20.apache.org,41843,1678575183185' in zk 2023-03-11 22:55:44,451 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-03-11 22:55:44,451 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:44,451 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:55:44,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:44,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:55:44,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:55:44,451 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-03-11 22:55:44,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:55:44,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:55:44,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-11 22:55:44,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:44,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:55:44,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-11 22:55:44,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:44,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase20.apache.org,41843,1678575183185': 2023-03-11 22:55:44,453 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-03-11 22:55:44,453 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-03-11 22:55:44,453 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 22:55:44,453 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 22:55:44,453 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-03-11 22:55:44,453 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 22:55:44,454 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-11 22:55:44,454 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-11 22:55:44,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-11 22:55:44,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:55:44,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:55:44,454 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-11 22:55:44,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-11 22:55:44,454 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:55:44,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:55:44,454 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:44,454 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:55:44,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:55:44,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-11 22:55:44,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-11 22:55:44,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:55:44,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-11 22:55:44,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:44,455 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:44,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:55:44,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-11 22:55:44,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:44,457 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:55:44,457 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:44,457 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:55:44,457 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:55:44,457 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:55:44,457 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-03-11 22:55:44,457 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 22:55:44,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:55:44,457 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-03-11 22:55:44,457 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 22:55:44,457 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-11 22:55:44,457 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-03-11 22:55:44,457 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-11 22:55:44,458 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:44,458 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-11 22:55:44,458 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-11 22:55:44,458 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-11 22:55:44,466 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:55:44,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:55:44,557 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 22:55:44,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 22:55:44,565 DEBUG [Listener at localhost.localdomain/41563] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-11 22:55:44,571 DEBUG [Listener at localhost.localdomain/41563] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-11 22:55:44,576 DEBUG [Listener at localhost.localdomain/41563] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-11 22:55:44,577 DEBUG [Listener at localhost.localdomain/41563] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-11 22:55:44,646 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-11 22:55:44,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-03-11 22:55:44,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-03-11 22:55:44,647 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-03-11 22:55:44,647 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:55:44,647 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-03-11 22:55:44,647 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-03-11 22:55:44,648 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-11 22:55:44,648 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-11 22:55:44,648 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:44,648 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:55:44,649 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:55:44,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:55:44,649 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:44,649 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-11 22:55:44,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-11 22:55:44,649 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-11 22:55:44,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-11 22:55:44,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-11 22:55:44,649 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-03-11 22:55:44,649 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-03-11 22:55:44,649 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-03-11 22:55:44,650 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-03-11 22:55:44,650 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-11 22:55:44,650 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-03-11 22:55:44,650 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1678575335623.1b0a50d6be32f97a1a81d7fd32d7f47b. 2023-03-11 22:55:44,650 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1678575335623.234c190ff73b29a4f3c5e6a6e630633f. 2023-03-11 22:55:44,650 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1678575335623.1b0a50d6be32f97a1a81d7fd32d7f47b. started... 2023-03-11 22:55:44,650 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1678575335623.234c190ff73b29a4f3c5e6a6e630633f. started... 2023-03-11 22:55:44,650 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1b0a50d6be32f97a1a81d7fd32d7f47b 2/2 column families, dataSize=138 B heapSize=944 B 2023-03-11 22:55:44,650 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 234c190ff73b29a4f3c5e6a6e630633f 2/2 column families, dataSize=138 B heapSize=944 B 2023-03-11 22:55:44,651 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-11 22:55:44,651 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-11 22:55:44,651 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1678575335623.b1b55df2e1201b31717429b4c155b168. 2023-03-11 22:55:44,652 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1678575335623.b1b55df2e1201b31717429b4c155b168. started... 2023-03-11 22:55:44,652 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing b1b55df2e1201b31717429b4c155b168 2/2 column families, dataSize=138 B heapSize=944 B 2023-03-11 22:55:44,704 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/b1b55df2e1201b31717429b4c155b168/.tmp/family1/fb525df4e4d14bbb8e83431768fc0653 2023-03-11 22:55:44,704 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/234c190ff73b29a4f3c5e6a6e630633f/.tmp/family1/8761452bf3114a009e88794cbcbf7e4f 2023-03-11 22:55:44,723 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8761452bf3114a009e88794cbcbf7e4f 2023-03-11 22:55:44,723 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fb525df4e4d14bbb8e83431768fc0653 2023-03-11 22:55:45,104 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/1b0a50d6be32f97a1a81d7fd32d7f47b/.tmp/family1/44db46e1313f46c78d7457f61ea12110 2023-03-11 22:55:45,127 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 44db46e1313f46c78d7457f61ea12110 2023-03-11 22:55:45,536 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/234c190ff73b29a4f3c5e6a6e630633f/.tmp/family2/3753c33da688432ebdb8d020b7470bf5 2023-03-11 22:55:45,539 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/1b0a50d6be32f97a1a81d7fd32d7f47b/.tmp/family2/d9fac314f7534f13a61bc8a603cffc91 2023-03-11 22:55:45,539 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/b1b55df2e1201b31717429b4c155b168/.tmp/family2/1e8b785dd2e94e41bedfd5f734ca1440 2023-03-11 22:55:45,540 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3753c33da688432ebdb8d020b7470bf5 2023-03-11 22:55:45,541 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/234c190ff73b29a4f3c5e6a6e630633f/.tmp/family1/8761452bf3114a009e88794cbcbf7e4f as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/234c190ff73b29a4f3c5e6a6e630633f/family1/8761452bf3114a009e88794cbcbf7e4f 2023-03-11 22:55:45,542 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1e8b785dd2e94e41bedfd5f734ca1440 2023-03-11 22:55:45,542 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d9fac314f7534f13a61bc8a603cffc91 2023-03-11 22:55:45,543 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/1b0a50d6be32f97a1a81d7fd32d7f47b/.tmp/family1/44db46e1313f46c78d7457f61ea12110 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/1b0a50d6be32f97a1a81d7fd32d7f47b/family1/44db46e1313f46c78d7457f61ea12110 2023-03-11 22:55:45,543 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/b1b55df2e1201b31717429b4c155b168/.tmp/family1/fb525df4e4d14bbb8e83431768fc0653 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/b1b55df2e1201b31717429b4c155b168/family1/fb525df4e4d14bbb8e83431768fc0653 2023-03-11 22:55:45,562 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8761452bf3114a009e88794cbcbf7e4f 2023-03-11 22:55:45,562 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 44db46e1313f46c78d7457f61ea12110 2023-03-11 22:55:45,563 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/234c190ff73b29a4f3c5e6a6e630633f/family1/8761452bf3114a009e88794cbcbf7e4f, entries=3, sequenceid=23, filesize=5.2 K 2023-03-11 22:55:45,563 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/1b0a50d6be32f97a1a81d7fd32d7f47b/family1/44db46e1313f46c78d7457f61ea12110, entries=3, sequenceid=23, filesize=5.2 K 2023-03-11 22:55:45,563 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/1b0a50d6be32f97a1a81d7fd32d7f47b/.tmp/family2/d9fac314f7534f13a61bc8a603cffc91 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/1b0a50d6be32f97a1a81d7fd32d7f47b/family2/d9fac314f7534f13a61bc8a603cffc91 2023-03-11 22:55:45,563 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/234c190ff73b29a4f3c5e6a6e630633f/.tmp/family2/3753c33da688432ebdb8d020b7470bf5 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/234c190ff73b29a4f3c5e6a6e630633f/family2/3753c33da688432ebdb8d020b7470bf5 2023-03-11 22:55:45,566 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fb525df4e4d14bbb8e83431768fc0653 2023-03-11 22:55:45,566 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/b1b55df2e1201b31717429b4c155b168/family1/fb525df4e4d14bbb8e83431768fc0653, entries=3, sequenceid=23, filesize=5.2 K 2023-03-11 22:55:45,566 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d9fac314f7534f13a61bc8a603cffc91 2023-03-11 22:55:45,567 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/b1b55df2e1201b31717429b4c155b168/.tmp/family2/1e8b785dd2e94e41bedfd5f734ca1440 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/b1b55df2e1201b31717429b4c155b168/family2/1e8b785dd2e94e41bedfd5f734ca1440 2023-03-11 22:55:45,567 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3753c33da688432ebdb8d020b7470bf5 2023-03-11 22:55:45,567 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/1b0a50d6be32f97a1a81d7fd32d7f47b/family2/d9fac314f7534f13a61bc8a603cffc91, entries=1, sequenceid=23, filesize=5.0 K 2023-03-11 22:55:45,567 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/234c190ff73b29a4f3c5e6a6e630633f/family2/3753c33da688432ebdb8d020b7470bf5, entries=1, sequenceid=23, filesize=5.0 K 2023-03-11 22:55:45,567 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 234c190ff73b29a4f3c5e6a6e630633f in 917ms, sequenceid=23, compaction requested=true 2023-03-11 22:55:45,567 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 1b0a50d6be32f97a1a81d7fd32d7f47b in 917ms, sequenceid=23, compaction requested=true 2023-03-11 22:55:45,567 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 234c190ff73b29a4f3c5e6a6e630633f: 2023-03-11 22:55:45,567 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1b0a50d6be32f97a1a81d7fd32d7f47b: 2023-03-11 22:55:45,567 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1678575335623.234c190ff73b29a4f3c5e6a6e630633f. 2023-03-11 22:55:45,567 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1678575335623.1b0a50d6be32f97a1a81d7fd32d7f47b. 2023-03-11 22:55:45,567 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-11 22:55:45,568 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-11 22:55:45,571 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1e8b785dd2e94e41bedfd5f734ca1440 2023-03-11 22:55:45,571 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/b1b55df2e1201b31717429b4c155b168/family2/1e8b785dd2e94e41bedfd5f734ca1440, entries=1, sequenceid=23, filesize=5.0 K 2023-03-11 22:55:45,571 INFO [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for b1b55df2e1201b31717429b4c155b168 in 919ms, sequenceid=23, compaction requested=true 2023-03-11 22:55:45,571 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for b1b55df2e1201b31717429b4c155b168: 2023-03-11 22:55:45,571 DEBUG [rs(jenkins-hbase20.apache.org,41843,1678575183185)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1678575335623.b1b55df2e1201b31717429b4c155b168. 2023-03-11 22:55:45,572 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-11 22:55:45,572 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-11 22:55:45,572 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:45,572 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-03-11 22:55:45,572 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-03-11 22:55:45,573 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:45,573 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-11 22:55:45,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:45,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:55:45,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:55:45,573 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-11 22:55:45,573 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-11 22:55:45,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:55:45,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:55:45,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-11 22:55:45,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:45,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:55:45,574 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41843,1678575183185' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-03-11 22:55:45,574 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5d2e4e6c[Count = 0] remaining members to acquire global barrier 2023-03-11 22:55:45,574 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-03-11 22:55:45,575 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-11 22:55:45,575 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-11 22:55:45,575 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-11 22:55:45,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-11 22:55:45,575 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-03-11 22:55:45,575 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-03-11 22:55:45,575 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:45,575 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-11 22:55:45,575 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase20.apache.org,41843,1678575183185' in zk 2023-03-11 22:55:45,576 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:45,576 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-03-11 22:55:45,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:45,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:55:45,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:55:45,576 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:55:45,576 DEBUG [member: 'jenkins-hbase20.apache.org,41843,1678575183185' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-03-11 22:55:45,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:55:45,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:55:45,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-11 22:55:45,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:45,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:55:45,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-11 22:55:45,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:45,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase20.apache.org,41843,1678575183185': 2023-03-11 22:55:45,578 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41843,1678575183185' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-03-11 22:55:45,578 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-03-11 22:55:45,578 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-11 22:55:45,578 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-11 22:55:45,578 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-03-11 22:55:45,578 INFO [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-11 22:55:45,579 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-11 22:55:45,579 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-11 22:55:45,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-11 22:55:45,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-11 22:55:45,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-11 22:55:45,579 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-11 22:55:45,579 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:55:45,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-11 22:55:45,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-11 22:55:45,580 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:55:45,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:55:45,580 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:45,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-11 22:55:45,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-11 22:55:45,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-11 22:55:45,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-11 22:55:45,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:45,581 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:45,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-11 22:55:45,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-11 22:55:45,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:45,582 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:45,582 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-11 22:55:45,582 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-11 22:55:45,582 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:45,582 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-11 22:55:45,582 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-03-11 22:55:45,582 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-11 22:55:45,582 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-11 22:55:45,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-11 22:55:45,582 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-11 22:55:45,582 DEBUG [(jenkins-hbase20.apache.org,44347,1678575181988)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-11 22:55:45,582 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-11 22:55:45,582 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-11 22:55:45,582 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-03-11 22:55:45,582 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-11 22:55:45,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-11 22:55:45,582 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-11 22:55:45,583 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-11 22:55:45,683 DEBUG [Listener at localhost.localdomain/41563] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-11 22:55:45,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44347] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-11 22:55:45,685 DEBUG [Listener at localhost.localdomain/41563] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-11 22:55:45,686 DEBUG [Listener at localhost.localdomain/41563] regionserver.HStore(1912): 1b0a50d6be32f97a1a81d7fd32d7f47b/family1 is initiating major compaction (all files) 2023-03-11 22:55:45,686 INFO [Listener at localhost.localdomain/41563] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-11 22:55:45,686 INFO [Listener at localhost.localdomain/41563] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-11 22:55:45,686 INFO [Listener at localhost.localdomain/41563] regionserver.HRegion(2259): Starting compaction of 1b0a50d6be32f97a1a81d7fd32d7f47b/family1 in testMajorCompactionFromAdmin,2,1678575335623.1b0a50d6be32f97a1a81d7fd32d7f47b. 2023-03-11 22:55:45,687 INFO [Listener at localhost.localdomain/41563] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/1b0a50d6be32f97a1a81d7fd32d7f47b/family1/821ee200bea44a06a0ff93520beaf364, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/1b0a50d6be32f97a1a81d7fd32d7f47b/family1/12f16bcd84b3442d9ccf6bdafdf4cdc1, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/1b0a50d6be32f97a1a81d7fd32d7f47b/family1/22bcac8e8e60435c9942ffe2d9a51779, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/1b0a50d6be32f97a1a81d7fd32d7f47b/family1/2c5aafd1a8e34a2d8f2cff5675a258f5, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/1b0a50d6be32f97a1a81d7fd32d7f47b/family1/44db46e1313f46c78d7457f61ea12110] into tmpdir=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/1b0a50d6be32f97a1a81d7fd32d7f47b/.tmp, totalSize=27.1 K 2023-03-11 22:55:45,688 DEBUG [Listener at localhost.localdomain/41563] compactions.Compactor(207): Compacting 821ee200bea44a06a0ff93520beaf364, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678575337773 2023-03-11 22:55:45,689 DEBUG [Listener at localhost.localdomain/41563] compactions.Compactor(207): Compacting 12f16bcd84b3442d9ccf6bdafdf4cdc1, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678575339664 2023-03-11 22:55:45,690 DEBUG [Listener at localhost.localdomain/41563] compactions.Compactor(207): Compacting 22bcac8e8e60435c9942ffe2d9a51779, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678575341550 2023-03-11 22:55:45,691 DEBUG [Listener at localhost.localdomain/41563] compactions.Compactor(207): Compacting 2c5aafd1a8e34a2d8f2cff5675a258f5, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678575342690 2023-03-11 22:55:45,692 DEBUG [Listener at localhost.localdomain/41563] compactions.Compactor(207): Compacting 44db46e1313f46c78d7457f61ea12110, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-11 22:55:45,709 INFO [Listener at localhost.localdomain/41563] throttle.PressureAwareThroughputController(145): 1b0a50d6be32f97a1a81d7fd32d7f47b#family1#compaction#198 average throughput is 0.57 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-11 22:55:46,153 INFO [Listener at localhost.localdomain/41563] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230311c72ee1c50cb64e9ea424da257ff27b3c_del 2023-03-11 22:55:46,153 INFO [Listener at localhost.localdomain/41563] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230311c72ee1c50cb64e9ea424da257ff27b3c_del to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230311c72ee1c50cb64e9ea424da257ff27b3c_del 2023-03-11 22:55:47,008 INFO [Listener at localhost.localdomain/41563] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 75f49745f6cd40bcb6e155833ae31b60 2023-03-11 22:55:47,009 DEBUG [Listener at localhost.localdomain/41563] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/1b0a50d6be32f97a1a81d7fd32d7f47b/.tmp/family1/75f49745f6cd40bcb6e155833ae31b60 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/1b0a50d6be32f97a1a81d7fd32d7f47b/family1/75f49745f6cd40bcb6e155833ae31b60 2023-03-11 22:55:47,028 INFO [Listener at localhost.localdomain/41563] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 75f49745f6cd40bcb6e155833ae31b60 2023-03-11 22:55:47,029 INFO [Listener at localhost.localdomain/41563] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 1b0a50d6be32f97a1a81d7fd32d7f47b/family1 of 1b0a50d6be32f97a1a81d7fd32d7f47b into 75f49745f6cd40bcb6e155833ae31b60(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-11 22:55:47,029 DEBUG [Listener at localhost.localdomain/41563] regionserver.HRegion(2289): Compaction status journal for 1b0a50d6be32f97a1a81d7fd32d7f47b: 2023-03-11 22:55:47,029 DEBUG [Listener at localhost.localdomain/41563] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-11 22:55:47,029 DEBUG [Listener at localhost.localdomain/41563] regionserver.HStore(1912): 1b0a50d6be32f97a1a81d7fd32d7f47b/family2 is initiating major compaction (all files) 2023-03-11 22:55:47,029 INFO [Listener at localhost.localdomain/41563] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-11 22:55:47,029 INFO [Listener at localhost.localdomain/41563] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-11 22:55:47,031 INFO [Listener at localhost.localdomain/41563] regionserver.HRegion(2259): Starting compaction of 1b0a50d6be32f97a1a81d7fd32d7f47b/family2 in testMajorCompactionFromAdmin,2,1678575335623.1b0a50d6be32f97a1a81d7fd32d7f47b. 2023-03-11 22:55:47,031 INFO [Listener at localhost.localdomain/41563] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/1b0a50d6be32f97a1a81d7fd32d7f47b/family2/3e7cb307c16846be914764d02bc44667, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/1b0a50d6be32f97a1a81d7fd32d7f47b/family2/8ab0fb40736644bfb244678b2ec26ec0, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/1b0a50d6be32f97a1a81d7fd32d7f47b/family2/6be6a80018154964bbb74f4627f0f181, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/1b0a50d6be32f97a1a81d7fd32d7f47b/family2/110df6b279a340f7a70e453f245c89db, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/1b0a50d6be32f97a1a81d7fd32d7f47b/family2/d9fac314f7534f13a61bc8a603cffc91] into tmpdir=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/1b0a50d6be32f97a1a81d7fd32d7f47b/.tmp, totalSize=25.4 K 2023-03-11 22:55:47,031 DEBUG [Listener at localhost.localdomain/41563] compactions.Compactor(207): Compacting 3e7cb307c16846be914764d02bc44667, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678575337773 2023-03-11 22:55:47,032 DEBUG [Listener at localhost.localdomain/41563] compactions.Compactor(207): Compacting 8ab0fb40736644bfb244678b2ec26ec0, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678575339664 2023-03-11 22:55:47,032 DEBUG [Listener at localhost.localdomain/41563] compactions.Compactor(207): Compacting 6be6a80018154964bbb74f4627f0f181, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678575341550 2023-03-11 22:55:47,032 DEBUG [Listener at localhost.localdomain/41563] compactions.Compactor(207): Compacting 110df6b279a340f7a70e453f245c89db, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678575342690 2023-03-11 22:55:47,032 DEBUG [Listener at localhost.localdomain/41563] compactions.Compactor(207): Compacting d9fac314f7534f13a61bc8a603cffc91, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-11 22:55:47,039 INFO [Listener at localhost.localdomain/41563] throttle.PressureAwareThroughputController(145): 1b0a50d6be32f97a1a81d7fd32d7f47b#family2#compaction#199 average throughput is 1.06 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-11 22:55:47,066 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/1b0a50d6be32f97a1a81d7fd32d7f47b/family1/821ee200bea44a06a0ff93520beaf364, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/1b0a50d6be32f97a1a81d7fd32d7f47b/family1/12f16bcd84b3442d9ccf6bdafdf4cdc1, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/1b0a50d6be32f97a1a81d7fd32d7f47b/family1/22bcac8e8e60435c9942ffe2d9a51779, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/1b0a50d6be32f97a1a81d7fd32d7f47b/family1/2c5aafd1a8e34a2d8f2cff5675a258f5, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/1b0a50d6be32f97a1a81d7fd32d7f47b/family1/44db46e1313f46c78d7457f61ea12110] to archive 2023-03-11 22:55:47,066 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 22:55:47,068 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/1b0a50d6be32f97a1a81d7fd32d7f47b/family1/821ee200bea44a06a0ff93520beaf364 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionFromAdmin/1b0a50d6be32f97a1a81d7fd32d7f47b/family1/821ee200bea44a06a0ff93520beaf364 2023-03-11 22:55:47,069 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/1b0a50d6be32f97a1a81d7fd32d7f47b/family1/12f16bcd84b3442d9ccf6bdafdf4cdc1 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionFromAdmin/1b0a50d6be32f97a1a81d7fd32d7f47b/family1/12f16bcd84b3442d9ccf6bdafdf4cdc1 2023-03-11 22:55:47,070 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/1b0a50d6be32f97a1a81d7fd32d7f47b/family1/22bcac8e8e60435c9942ffe2d9a51779 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionFromAdmin/1b0a50d6be32f97a1a81d7fd32d7f47b/family1/22bcac8e8e60435c9942ffe2d9a51779 2023-03-11 22:55:47,071 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/1b0a50d6be32f97a1a81d7fd32d7f47b/family1/2c5aafd1a8e34a2d8f2cff5675a258f5 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionFromAdmin/1b0a50d6be32f97a1a81d7fd32d7f47b/family1/2c5aafd1a8e34a2d8f2cff5675a258f5 2023-03-11 22:55:47,072 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/1b0a50d6be32f97a1a81d7fd32d7f47b/family1/44db46e1313f46c78d7457f61ea12110 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionFromAdmin/1b0a50d6be32f97a1a81d7fd32d7f47b/family1/44db46e1313f46c78d7457f61ea12110 2023-03-11 22:55:47,450 INFO [Listener at localhost.localdomain/41563] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230311cac4bbf56c0f4b4f8c83173a353e6f00_del 2023-03-11 22:55:47,450 INFO [Listener at localhost.localdomain/41563] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230311cac4bbf56c0f4b4f8c83173a353e6f00_del to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20230311cac4bbf56c0f4b4f8c83173a353e6f00_del 2023-03-11 22:55:48,273 INFO [Listener at localhost.localdomain/41563] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fb8071a67530469388cfa3d7e93d80de 2023-03-11 22:55:48,275 DEBUG [Listener at localhost.localdomain/41563] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/1b0a50d6be32f97a1a81d7fd32d7f47b/.tmp/family2/fb8071a67530469388cfa3d7e93d80de as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/1b0a50d6be32f97a1a81d7fd32d7f47b/family2/fb8071a67530469388cfa3d7e93d80de 2023-03-11 22:55:48,280 INFO [Listener at localhost.localdomain/41563] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fb8071a67530469388cfa3d7e93d80de 2023-03-11 22:55:48,281 INFO [Listener at localhost.localdomain/41563] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 1b0a50d6be32f97a1a81d7fd32d7f47b/family2 of 1b0a50d6be32f97a1a81d7fd32d7f47b into fb8071a67530469388cfa3d7e93d80de(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-11 22:55:48,281 DEBUG [Listener at localhost.localdomain/41563] regionserver.HRegion(2289): Compaction status journal for 1b0a50d6be32f97a1a81d7fd32d7f47b: 2023-03-11 22:55:48,281 DEBUG [Listener at localhost.localdomain/41563] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-11 22:55:48,281 DEBUG [Listener at localhost.localdomain/41563] regionserver.HStore(1912): 234c190ff73b29a4f3c5e6a6e630633f/family1 is initiating major compaction (all files) 2023-03-11 22:55:48,282 INFO [Listener at localhost.localdomain/41563] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-11 22:55:48,282 INFO [Listener at localhost.localdomain/41563] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-11 22:55:48,282 INFO [Listener at localhost.localdomain/41563] regionserver.HRegion(2259): Starting compaction of 234c190ff73b29a4f3c5e6a6e630633f/family1 in testMajorCompactionFromAdmin,,1678575335623.234c190ff73b29a4f3c5e6a6e630633f. 2023-03-11 22:55:48,283 INFO [Listener at localhost.localdomain/41563] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/234c190ff73b29a4f3c5e6a6e630633f/family1/2c8bec891dc34de795cf2d6eabe21d0d, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/234c190ff73b29a4f3c5e6a6e630633f/family1/b1b58735286d411f8ddd28ca190e2098, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/234c190ff73b29a4f3c5e6a6e630633f/family1/31084cc6a03e49ada023fcba7becb28b, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/234c190ff73b29a4f3c5e6a6e630633f/family1/addeabc6385d460e9ab46da812de3268, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/234c190ff73b29a4f3c5e6a6e630633f/family1/8761452bf3114a009e88794cbcbf7e4f] into tmpdir=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/234c190ff73b29a4f3c5e6a6e630633f/.tmp, totalSize=27.1 K 2023-03-11 22:55:48,283 DEBUG [Listener at localhost.localdomain/41563] compactions.Compactor(207): Compacting 2c8bec891dc34de795cf2d6eabe21d0d, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678575337773 2023-03-11 22:55:48,284 DEBUG [Listener at localhost.localdomain/41563] compactions.Compactor(207): Compacting b1b58735286d411f8ddd28ca190e2098, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678575339664 2023-03-11 22:55:48,284 DEBUG [Listener at localhost.localdomain/41563] compactions.Compactor(207): Compacting 31084cc6a03e49ada023fcba7becb28b, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678575341550 2023-03-11 22:55:48,285 DEBUG [Listener at localhost.localdomain/41563] compactions.Compactor(207): Compacting addeabc6385d460e9ab46da812de3268, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678575342689 2023-03-11 22:55:48,285 DEBUG [Listener at localhost.localdomain/41563] compactions.Compactor(207): Compacting 8761452bf3114a009e88794cbcbf7e4f, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-11 22:55:48,298 INFO [Listener at localhost.localdomain/41563] throttle.PressureAwareThroughputController(145): 234c190ff73b29a4f3c5e6a6e630633f#family1#compaction#200 average throughput is 0.57 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-11 22:55:48,364 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/1b0a50d6be32f97a1a81d7fd32d7f47b/family2/3e7cb307c16846be914764d02bc44667, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/1b0a50d6be32f97a1a81d7fd32d7f47b/family2/8ab0fb40736644bfb244678b2ec26ec0, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/1b0a50d6be32f97a1a81d7fd32d7f47b/family2/6be6a80018154964bbb74f4627f0f181, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/1b0a50d6be32f97a1a81d7fd32d7f47b/family2/110df6b279a340f7a70e453f245c89db, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/1b0a50d6be32f97a1a81d7fd32d7f47b/family2/d9fac314f7534f13a61bc8a603cffc91] to archive 2023-03-11 22:55:48,365 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 22:55:48,366 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/1b0a50d6be32f97a1a81d7fd32d7f47b/family2/3e7cb307c16846be914764d02bc44667 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionFromAdmin/1b0a50d6be32f97a1a81d7fd32d7f47b/family2/3e7cb307c16846be914764d02bc44667 2023-03-11 22:55:48,367 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/1b0a50d6be32f97a1a81d7fd32d7f47b/family2/8ab0fb40736644bfb244678b2ec26ec0 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionFromAdmin/1b0a50d6be32f97a1a81d7fd32d7f47b/family2/8ab0fb40736644bfb244678b2ec26ec0 2023-03-11 22:55:48,368 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/1b0a50d6be32f97a1a81d7fd32d7f47b/family2/6be6a80018154964bbb74f4627f0f181 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionFromAdmin/1b0a50d6be32f97a1a81d7fd32d7f47b/family2/6be6a80018154964bbb74f4627f0f181 2023-03-11 22:55:48,369 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/1b0a50d6be32f97a1a81d7fd32d7f47b/family2/110df6b279a340f7a70e453f245c89db to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionFromAdmin/1b0a50d6be32f97a1a81d7fd32d7f47b/family2/110df6b279a340f7a70e453f245c89db 2023-03-11 22:55:48,370 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/1b0a50d6be32f97a1a81d7fd32d7f47b/family2/d9fac314f7534f13a61bc8a603cffc91 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionFromAdmin/1b0a50d6be32f97a1a81d7fd32d7f47b/family2/d9fac314f7534f13a61bc8a603cffc91 2023-03-11 22:55:48,740 INFO [Listener at localhost.localdomain/41563] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e2023031175cd6bab16a14864ba00c974788dc711_del 2023-03-11 22:55:48,740 INFO [Listener at localhost.localdomain/41563] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023031175cd6bab16a14864ba00c974788dc711_del to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023031175cd6bab16a14864ba00c974788dc711_del 2023-03-11 22:55:49,591 INFO [Listener at localhost.localdomain/41563] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0c1cfb746d6743769be6dbebf8bba264 2023-03-11 22:55:49,592 DEBUG [Listener at localhost.localdomain/41563] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/234c190ff73b29a4f3c5e6a6e630633f/.tmp/family1/0c1cfb746d6743769be6dbebf8bba264 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/234c190ff73b29a4f3c5e6a6e630633f/family1/0c1cfb746d6743769be6dbebf8bba264 2023-03-11 22:55:49,620 INFO [Listener at localhost.localdomain/41563] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0c1cfb746d6743769be6dbebf8bba264 2023-03-11 22:55:49,621 INFO [Listener at localhost.localdomain/41563] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 234c190ff73b29a4f3c5e6a6e630633f/family1 of 234c190ff73b29a4f3c5e6a6e630633f into 0c1cfb746d6743769be6dbebf8bba264(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-11 22:55:49,621 DEBUG [Listener at localhost.localdomain/41563] regionserver.HRegion(2289): Compaction status journal for 234c190ff73b29a4f3c5e6a6e630633f: 2023-03-11 22:55:49,621 DEBUG [Listener at localhost.localdomain/41563] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-11 22:55:49,622 DEBUG [Listener at localhost.localdomain/41563] regionserver.HStore(1912): 234c190ff73b29a4f3c5e6a6e630633f/family2 is initiating major compaction (all files) 2023-03-11 22:55:49,622 INFO [Listener at localhost.localdomain/41563] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-11 22:55:49,622 INFO [Listener at localhost.localdomain/41563] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-11 22:55:49,623 INFO [Listener at localhost.localdomain/41563] regionserver.HRegion(2259): Starting compaction of 234c190ff73b29a4f3c5e6a6e630633f/family2 in testMajorCompactionFromAdmin,,1678575335623.234c190ff73b29a4f3c5e6a6e630633f. 2023-03-11 22:55:49,623 INFO [Listener at localhost.localdomain/41563] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/234c190ff73b29a4f3c5e6a6e630633f/family2/c4141e7a55b4465390d3c603afe0689a, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/234c190ff73b29a4f3c5e6a6e630633f/family2/29d090ea104049679d9ab079cad5fd40, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/234c190ff73b29a4f3c5e6a6e630633f/family2/5a13448e4ada443f8582e56235401844, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/234c190ff73b29a4f3c5e6a6e630633f/family2/908dda519b5b4d77bd64d1e0a0c87e31, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/234c190ff73b29a4f3c5e6a6e630633f/family2/3753c33da688432ebdb8d020b7470bf5] into tmpdir=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/234c190ff73b29a4f3c5e6a6e630633f/.tmp, totalSize=25.4 K 2023-03-11 22:55:49,623 DEBUG [Listener at localhost.localdomain/41563] compactions.Compactor(207): Compacting c4141e7a55b4465390d3c603afe0689a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678575337773 2023-03-11 22:55:49,624 DEBUG [Listener at localhost.localdomain/41563] compactions.Compactor(207): Compacting 29d090ea104049679d9ab079cad5fd40, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678575339664 2023-03-11 22:55:49,624 DEBUG [Listener at localhost.localdomain/41563] compactions.Compactor(207): Compacting 5a13448e4ada443f8582e56235401844, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678575341550 2023-03-11 22:55:49,624 DEBUG [Listener at localhost.localdomain/41563] compactions.Compactor(207): Compacting 908dda519b5b4d77bd64d1e0a0c87e31, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678575342689 2023-03-11 22:55:49,625 DEBUG [Listener at localhost.localdomain/41563] compactions.Compactor(207): Compacting 3753c33da688432ebdb8d020b7470bf5, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-11 22:55:49,638 INFO [Listener at localhost.localdomain/41563] throttle.PressureAwareThroughputController(145): 234c190ff73b29a4f3c5e6a6e630633f#family2#compaction#201 average throughput is 0.12 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-11 22:55:49,652 INFO [Listener at localhost.localdomain/41563] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230311a2fec42599be4143a64a77ea9d409568_del 2023-03-11 22:55:49,653 INFO [Listener at localhost.localdomain/41563] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230311a2fec42599be4143a64a77ea9d409568_del to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20230311a2fec42599be4143a64a77ea9d409568_del 2023-03-11 22:55:49,667 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/234c190ff73b29a4f3c5e6a6e630633f/family1/2c8bec891dc34de795cf2d6eabe21d0d, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/234c190ff73b29a4f3c5e6a6e630633f/family1/b1b58735286d411f8ddd28ca190e2098, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/234c190ff73b29a4f3c5e6a6e630633f/family1/31084cc6a03e49ada023fcba7becb28b, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/234c190ff73b29a4f3c5e6a6e630633f/family1/addeabc6385d460e9ab46da812de3268, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/234c190ff73b29a4f3c5e6a6e630633f/family1/8761452bf3114a009e88794cbcbf7e4f] to archive 2023-03-11 22:55:49,668 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 22:55:49,670 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/234c190ff73b29a4f3c5e6a6e630633f/family1/2c8bec891dc34de795cf2d6eabe21d0d to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionFromAdmin/234c190ff73b29a4f3c5e6a6e630633f/family1/2c8bec891dc34de795cf2d6eabe21d0d 2023-03-11 22:55:49,671 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/234c190ff73b29a4f3c5e6a6e630633f/family1/b1b58735286d411f8ddd28ca190e2098 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionFromAdmin/234c190ff73b29a4f3c5e6a6e630633f/family1/b1b58735286d411f8ddd28ca190e2098 2023-03-11 22:55:49,672 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/234c190ff73b29a4f3c5e6a6e630633f/family1/31084cc6a03e49ada023fcba7becb28b to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionFromAdmin/234c190ff73b29a4f3c5e6a6e630633f/family1/31084cc6a03e49ada023fcba7becb28b 2023-03-11 22:55:49,673 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/234c190ff73b29a4f3c5e6a6e630633f/family1/addeabc6385d460e9ab46da812de3268 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionFromAdmin/234c190ff73b29a4f3c5e6a6e630633f/family1/addeabc6385d460e9ab46da812de3268 2023-03-11 22:55:49,674 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/234c190ff73b29a4f3c5e6a6e630633f/family1/8761452bf3114a009e88794cbcbf7e4f to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionFromAdmin/234c190ff73b29a4f3c5e6a6e630633f/family1/8761452bf3114a009e88794cbcbf7e4f 2023-03-11 22:55:50,067 INFO [Listener at localhost.localdomain/41563] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 62bb610d777d4dd2bfc67ee94c994a70 2023-03-11 22:55:50,067 DEBUG [Listener at localhost.localdomain/41563] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/234c190ff73b29a4f3c5e6a6e630633f/.tmp/family2/62bb610d777d4dd2bfc67ee94c994a70 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/234c190ff73b29a4f3c5e6a6e630633f/family2/62bb610d777d4dd2bfc67ee94c994a70 2023-03-11 22:55:50,070 INFO [Listener at localhost.localdomain/41563] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 62bb610d777d4dd2bfc67ee94c994a70 2023-03-11 22:55:50,071 INFO [Listener at localhost.localdomain/41563] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 234c190ff73b29a4f3c5e6a6e630633f/family2 of 234c190ff73b29a4f3c5e6a6e630633f into 62bb610d777d4dd2bfc67ee94c994a70(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-11 22:55:50,071 DEBUG [Listener at localhost.localdomain/41563] regionserver.HRegion(2289): Compaction status journal for 234c190ff73b29a4f3c5e6a6e630633f: 2023-03-11 22:55:50,071 DEBUG [Listener at localhost.localdomain/41563] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-11 22:55:50,071 DEBUG [Listener at localhost.localdomain/41563] regionserver.HStore(1912): b1b55df2e1201b31717429b4c155b168/family1 is initiating major compaction (all files) 2023-03-11 22:55:50,071 INFO [Listener at localhost.localdomain/41563] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-11 22:55:50,071 INFO [Listener at localhost.localdomain/41563] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-11 22:55:50,072 INFO [Listener at localhost.localdomain/41563] regionserver.HRegion(2259): Starting compaction of b1b55df2e1201b31717429b4c155b168/family1 in testMajorCompactionFromAdmin,1,1678575335623.b1b55df2e1201b31717429b4c155b168. 2023-03-11 22:55:50,072 INFO [Listener at localhost.localdomain/41563] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/b1b55df2e1201b31717429b4c155b168/family1/e8cc24be030e4f718f9f980653ad1f17, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/b1b55df2e1201b31717429b4c155b168/family1/c476f16414304318bb8aa202a7714f97, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/b1b55df2e1201b31717429b4c155b168/family1/253d3939a7044c21b7f9c2deff925e37, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/b1b55df2e1201b31717429b4c155b168/family1/849dfb1d5ff84846a1123ca028c1d7e5, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/b1b55df2e1201b31717429b4c155b168/family1/fb525df4e4d14bbb8e83431768fc0653] into tmpdir=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/b1b55df2e1201b31717429b4c155b168/.tmp, totalSize=27.1 K 2023-03-11 22:55:50,073 DEBUG [Listener at localhost.localdomain/41563] compactions.Compactor(207): Compacting e8cc24be030e4f718f9f980653ad1f17, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678575337773 2023-03-11 22:55:50,073 DEBUG [Listener at localhost.localdomain/41563] compactions.Compactor(207): Compacting c476f16414304318bb8aa202a7714f97, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678575339664 2023-03-11 22:55:50,073 DEBUG [Listener at localhost.localdomain/41563] compactions.Compactor(207): Compacting 253d3939a7044c21b7f9c2deff925e37, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678575341550 2023-03-11 22:55:50,074 DEBUG [Listener at localhost.localdomain/41563] compactions.Compactor(207): Compacting 849dfb1d5ff84846a1123ca028c1d7e5, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678575342689 2023-03-11 22:55:50,074 DEBUG [Listener at localhost.localdomain/41563] compactions.Compactor(207): Compacting fb525df4e4d14bbb8e83431768fc0653, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-11 22:55:50,081 INFO [Listener at localhost.localdomain/41563] throttle.PressureAwareThroughputController(145): b1b55df2e1201b31717429b4c155b168#family1#compaction#202 average throughput is 1.72 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-11 22:55:50,164 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/234c190ff73b29a4f3c5e6a6e630633f/family2/c4141e7a55b4465390d3c603afe0689a, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/234c190ff73b29a4f3c5e6a6e630633f/family2/29d090ea104049679d9ab079cad5fd40, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/234c190ff73b29a4f3c5e6a6e630633f/family2/5a13448e4ada443f8582e56235401844, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/234c190ff73b29a4f3c5e6a6e630633f/family2/908dda519b5b4d77bd64d1e0a0c87e31, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/234c190ff73b29a4f3c5e6a6e630633f/family2/3753c33da688432ebdb8d020b7470bf5] to archive 2023-03-11 22:55:50,165 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 22:55:50,166 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/234c190ff73b29a4f3c5e6a6e630633f/family2/c4141e7a55b4465390d3c603afe0689a to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionFromAdmin/234c190ff73b29a4f3c5e6a6e630633f/family2/c4141e7a55b4465390d3c603afe0689a 2023-03-11 22:55:50,167 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/234c190ff73b29a4f3c5e6a6e630633f/family2/29d090ea104049679d9ab079cad5fd40 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionFromAdmin/234c190ff73b29a4f3c5e6a6e630633f/family2/29d090ea104049679d9ab079cad5fd40 2023-03-11 22:55:50,168 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/234c190ff73b29a4f3c5e6a6e630633f/family2/5a13448e4ada443f8582e56235401844 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionFromAdmin/234c190ff73b29a4f3c5e6a6e630633f/family2/5a13448e4ada443f8582e56235401844 2023-03-11 22:55:50,169 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/234c190ff73b29a4f3c5e6a6e630633f/family2/908dda519b5b4d77bd64d1e0a0c87e31 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionFromAdmin/234c190ff73b29a4f3c5e6a6e630633f/family2/908dda519b5b4d77bd64d1e0a0c87e31 2023-03-11 22:55:50,170 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/234c190ff73b29a4f3c5e6a6e630633f/family2/3753c33da688432ebdb8d020b7470bf5 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionFromAdmin/234c190ff73b29a4f3c5e6a6e630633f/family2/3753c33da688432ebdb8d020b7470bf5 2023-03-11 22:55:50,513 INFO [Listener at localhost.localdomain/41563] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202303114a2c227dac9749368edd0e20455989c0_del 2023-03-11 22:55:50,514 INFO [Listener at localhost.localdomain/41563] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202303114a2c227dac9749368edd0e20455989c0_del to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202303114a2c227dac9749368edd0e20455989c0_del 2023-03-11 22:55:51,370 INFO [Listener at localhost.localdomain/41563] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1402525b649b48d1a14407bba92c7f9a 2023-03-11 22:55:51,371 DEBUG [Listener at localhost.localdomain/41563] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/b1b55df2e1201b31717429b4c155b168/.tmp/family1/1402525b649b48d1a14407bba92c7f9a as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/b1b55df2e1201b31717429b4c155b168/family1/1402525b649b48d1a14407bba92c7f9a 2023-03-11 22:55:51,399 INFO [Listener at localhost.localdomain/41563] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1402525b649b48d1a14407bba92c7f9a 2023-03-11 22:55:51,401 INFO [Listener at localhost.localdomain/41563] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in b1b55df2e1201b31717429b4c155b168/family1 of b1b55df2e1201b31717429b4c155b168 into 1402525b649b48d1a14407bba92c7f9a(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-11 22:55:51,401 DEBUG [Listener at localhost.localdomain/41563] regionserver.HRegion(2289): Compaction status journal for b1b55df2e1201b31717429b4c155b168: 2023-03-11 22:55:51,401 DEBUG [Listener at localhost.localdomain/41563] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-11 22:55:51,401 DEBUG [Listener at localhost.localdomain/41563] regionserver.HStore(1912): b1b55df2e1201b31717429b4c155b168/family2 is initiating major compaction (all files) 2023-03-11 22:55:51,401 INFO [Listener at localhost.localdomain/41563] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-11 22:55:51,402 INFO [Listener at localhost.localdomain/41563] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-11 22:55:51,402 INFO [Listener at localhost.localdomain/41563] regionserver.HRegion(2259): Starting compaction of b1b55df2e1201b31717429b4c155b168/family2 in testMajorCompactionFromAdmin,1,1678575335623.b1b55df2e1201b31717429b4c155b168. 2023-03-11 22:55:51,403 INFO [Listener at localhost.localdomain/41563] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/b1b55df2e1201b31717429b4c155b168/family2/f71f71c639724d0ca92784d052c94abb, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/b1b55df2e1201b31717429b4c155b168/family2/5fbc083fc69e4551978b0b9c1f01bd34, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/b1b55df2e1201b31717429b4c155b168/family2/3f1a98da6eba4964a2860890e558ba16, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/b1b55df2e1201b31717429b4c155b168/family2/29d43dc05c4f4f5d8d51a6a120c52bb3, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/b1b55df2e1201b31717429b4c155b168/family2/1e8b785dd2e94e41bedfd5f734ca1440] into tmpdir=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/b1b55df2e1201b31717429b4c155b168/.tmp, totalSize=25.4 K 2023-03-11 22:55:51,403 DEBUG [Listener at localhost.localdomain/41563] compactions.Compactor(207): Compacting f71f71c639724d0ca92784d052c94abb, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678575337773 2023-03-11 22:55:51,404 DEBUG [Listener at localhost.localdomain/41563] compactions.Compactor(207): Compacting 5fbc083fc69e4551978b0b9c1f01bd34, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678575339664 2023-03-11 22:55:51,404 DEBUG [Listener at localhost.localdomain/41563] compactions.Compactor(207): Compacting 3f1a98da6eba4964a2860890e558ba16, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678575341550 2023-03-11 22:55:51,404 DEBUG [Listener at localhost.localdomain/41563] compactions.Compactor(207): Compacting 29d43dc05c4f4f5d8d51a6a120c52bb3, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678575342689 2023-03-11 22:55:51,405 DEBUG [Listener at localhost.localdomain/41563] compactions.Compactor(207): Compacting 1e8b785dd2e94e41bedfd5f734ca1440, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-11 22:55:51,434 INFO [Listener at localhost.localdomain/41563] throttle.PressureAwareThroughputController(145): b1b55df2e1201b31717429b4c155b168#family2#compaction#203 average throughput is 0.06 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-11 22:55:51,453 INFO [Listener at localhost.localdomain/41563] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230311417d702725814dd5ae00dac4d579cc25_del 2023-03-11 22:55:51,454 INFO [Listener at localhost.localdomain/41563] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230311417d702725814dd5ae00dac4d579cc25_del to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20230311417d702725814dd5ae00dac4d579cc25_del 2023-03-11 22:55:51,468 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/b1b55df2e1201b31717429b4c155b168/family1/e8cc24be030e4f718f9f980653ad1f17, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/b1b55df2e1201b31717429b4c155b168/family1/c476f16414304318bb8aa202a7714f97, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/b1b55df2e1201b31717429b4c155b168/family1/253d3939a7044c21b7f9c2deff925e37, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/b1b55df2e1201b31717429b4c155b168/family1/849dfb1d5ff84846a1123ca028c1d7e5, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/b1b55df2e1201b31717429b4c155b168/family1/fb525df4e4d14bbb8e83431768fc0653] to archive 2023-03-11 22:55:51,468 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 22:55:51,470 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/b1b55df2e1201b31717429b4c155b168/family1/e8cc24be030e4f718f9f980653ad1f17 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionFromAdmin/b1b55df2e1201b31717429b4c155b168/family1/e8cc24be030e4f718f9f980653ad1f17 2023-03-11 22:55:51,471 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/b1b55df2e1201b31717429b4c155b168/family1/c476f16414304318bb8aa202a7714f97 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionFromAdmin/b1b55df2e1201b31717429b4c155b168/family1/c476f16414304318bb8aa202a7714f97 2023-03-11 22:55:51,472 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/b1b55df2e1201b31717429b4c155b168/family1/253d3939a7044c21b7f9c2deff925e37 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionFromAdmin/b1b55df2e1201b31717429b4c155b168/family1/253d3939a7044c21b7f9c2deff925e37 2023-03-11 22:55:51,473 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/b1b55df2e1201b31717429b4c155b168/family1/849dfb1d5ff84846a1123ca028c1d7e5 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionFromAdmin/b1b55df2e1201b31717429b4c155b168/family1/849dfb1d5ff84846a1123ca028c1d7e5 2023-03-11 22:55:51,474 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/b1b55df2e1201b31717429b4c155b168/family1/fb525df4e4d14bbb8e83431768fc0653 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionFromAdmin/b1b55df2e1201b31717429b4c155b168/family1/fb525df4e4d14bbb8e83431768fc0653 2023-03-11 22:55:52,275 INFO [Listener at localhost.localdomain/41563] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 15eabe0fcdcf4e8e8a66a64dcf40c7ea 2023-03-11 22:55:52,276 DEBUG [Listener at localhost.localdomain/41563] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/b1b55df2e1201b31717429b4c155b168/.tmp/family2/15eabe0fcdcf4e8e8a66a64dcf40c7ea as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/b1b55df2e1201b31717429b4c155b168/family2/15eabe0fcdcf4e8e8a66a64dcf40c7ea 2023-03-11 22:55:52,282 INFO [Listener at localhost.localdomain/41563] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 15eabe0fcdcf4e8e8a66a64dcf40c7ea 2023-03-11 22:55:52,283 INFO [Listener at localhost.localdomain/41563] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in b1b55df2e1201b31717429b4c155b168/family2 of b1b55df2e1201b31717429b4c155b168 into 15eabe0fcdcf4e8e8a66a64dcf40c7ea(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-11 22:55:52,283 DEBUG [Listener at localhost.localdomain/41563] regionserver.HRegion(2289): Compaction status journal for b1b55df2e1201b31717429b4c155b168: 2023-03-11 22:55:52,287 DEBUG [Listener at localhost.localdomain/41563] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-11 22:55:52,291 DEBUG [Listener at localhost.localdomain/41563] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-11 22:55:52,296 DEBUG [Listener at localhost.localdomain/41563] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-11 22:55:52,296 DEBUG [Listener at localhost.localdomain/41563] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-11 22:55:52,301 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=44347] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xA3\xBE^\xFAN\xEB\xB3{\xE6\x9FTA1x\xFF<"\x10\xF3x@]@\x0F\xAC\xE0Mv;u@\xF6\xAE\xE0*\x10\xE1~q\xC9zs;\xD6\x1B\x94!\x82\xD1\x93\x99\x872\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testMajorCompactionFromAdmin 2023-03-11 22:55:52,328 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] procedure2.ProcedureExecutor(1029): Stored pid=123, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-03-11 22:55:52,329 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=123, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-03-11 22:55:52,329 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionFromAdmin', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-11 22:55:52,329 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=123, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1678575952329 2023-03-11 22:55:52,330 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-11 22:55:52,364 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/b1b55df2e1201b31717429b4c155b168/family2/f71f71c639724d0ca92784d052c94abb, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/b1b55df2e1201b31717429b4c155b168/family2/5fbc083fc69e4551978b0b9c1f01bd34, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/b1b55df2e1201b31717429b4c155b168/family2/3f1a98da6eba4964a2860890e558ba16, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/b1b55df2e1201b31717429b4c155b168/family2/29d43dc05c4f4f5d8d51a6a120c52bb3, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/b1b55df2e1201b31717429b4c155b168/family2/1e8b785dd2e94e41bedfd5f734ca1440] to archive 2023-03-11 22:55:52,365 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 22:55:52,366 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/b1b55df2e1201b31717429b4c155b168/family2/f71f71c639724d0ca92784d052c94abb to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionFromAdmin/b1b55df2e1201b31717429b4c155b168/family2/f71f71c639724d0ca92784d052c94abb 2023-03-11 22:55:52,367 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/b1b55df2e1201b31717429b4c155b168/family2/5fbc083fc69e4551978b0b9c1f01bd34 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionFromAdmin/b1b55df2e1201b31717429b4c155b168/family2/5fbc083fc69e4551978b0b9c1f01bd34 2023-03-11 22:55:52,368 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/b1b55df2e1201b31717429b4c155b168/family2/3f1a98da6eba4964a2860890e558ba16 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionFromAdmin/b1b55df2e1201b31717429b4c155b168/family2/3f1a98da6eba4964a2860890e558ba16 2023-03-11 22:55:52,369 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/b1b55df2e1201b31717429b4c155b168/family2/29d43dc05c4f4f5d8d51a6a120c52bb3 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionFromAdmin/b1b55df2e1201b31717429b4c155b168/family2/29d43dc05c4f4f5d8d51a6a120c52bb3 2023-03-11 22:55:52,370 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/b1b55df2e1201b31717429b4c155b168/family2/1e8b785dd2e94e41bedfd5f734ca1440 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionFromAdmin/b1b55df2e1201b31717429b4c155b168/family2/1e8b785dd2e94e41bedfd5f734ca1440 2023-03-11 22:55:52,616 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 3 del files, 12 selected files, and 0 irrelevant files table 'testMajorCompactionFromAdmin' and column 'family1' 2023-03-11 22:55:52,635 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e2023031175cd6bab16a14864ba00c974788dc711_del 2023-03-11 22:55:52,655 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202303114a2c227dac9749368edd0e20455989c0_del 2023-03-11 22:55:52,673 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230311c72ee1c50cb64e9ea424da257ff27b3c_del 2023-03-11 22:55:52,673 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='testMajorCompactionFromAdmin' column='family1' 2023-03-11 22:55:52,673 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] zookeeper.ReadOnlyZKClient(139): Connect 0x0450eb4a to 127.0.0.1:51815 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-11 22:55:52,677 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@374b171, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-11 22:55:52,678 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230311 for table='testMajorCompactionFromAdmin' and column='family1' 2023-03-11 22:55:53,630 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230311efa6d3f7e64e41279a3ceac2796a5cbb to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230311efa6d3f7e64e41279a3ceac2796a5cbb 2023-03-11 22:55:53,631 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230311 table='testMajorCompactionFromAdmin' column='family1' 2023-03-11 22:55:53,643 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-11 22:55:53,645 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:48300, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-11 22:55:53,654 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-11 22:55:53,656 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:38746, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-11 22:55:53,686 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230311/family1/4fd4c651127c469fa182cbc93dd7f1fa first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x07] 2023-03-11 22:55:53,687 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionFromAdmin,1,1678575335623.b1b55df2e1201b31717429b4c155b168., hostname=jenkins-hbase20.apache.org,41843,1678575183185, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230311/family1/4fd4c651127c469fa182cbc93dd7f1fa}] 2023-03-11 22:55:53,694 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230311/family1/4fd4c651127c469fa182cbc93dd7f1fa for inclusion in b1b55df2e1201b31717429b4c155b168/family1 2023-03-11 22:55:53,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x07 2023-03-11 22:55:53,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.HStore(777): Region bounds: first=1 last=2 2023-03-11 22:55:53,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.HRegion(2446): Flush status journal for b1b55df2e1201b31717429b4c155b168: 2023-03-11 22:55:53,714 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230311/family1/4fd4c651127c469fa182cbc93dd7f1fa to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testMajorCompactionFromAdmin__s5diar14n0t93qesnkcnvnrtt0p9r9ikgnhncgklksgshmdols9vu1selc3ihp6b/family1/4fd4c651127c469fa182cbc93dd7f1fa 2023-03-11 22:55:53,715 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testMajorCompactionFromAdmin__s5diar14n0t93qesnkcnvnrtt0p9r9ikgnhncgklksgshmdols9vu1selc3ihp6b/family1/4fd4c651127c469fa182cbc93dd7f1fa as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/b1b55df2e1201b31717429b4c155b168/family1/2d3e39200c1d43fd8d892b147a03400a_SeqId_28_ 2023-03-11 22:55:53,716 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testMajorCompactionFromAdmin__s5diar14n0t93qesnkcnvnrtt0p9r9ikgnhncgklksgshmdols9vu1selc3ihp6b/family1/4fd4c651127c469fa182cbc93dd7f1fa into b1b55df2e1201b31717429b4c155b168/family1 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/b1b55df2e1201b31717429b4c155b168/family1/2d3e39200c1d43fd8d892b147a03400a_SeqId_28_ - updating store file list. 2023-03-11 22:55:53,736 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/b1b55df2e1201b31717429b4c155b168/family1/2d3e39200c1d43fd8d892b147a03400a_SeqId_28_ into b1b55df2e1201b31717429b4c155b168/family1 2023-03-11 22:55:53,736 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testMajorCompactionFromAdmin__s5diar14n0t93qesnkcnvnrtt0p9r9ikgnhncgklksgshmdols9vu1selc3ihp6b/family1/4fd4c651127c469fa182cbc93dd7f1fa into b1b55df2e1201b31717429b4c155b168/family1 (new location: hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/b1b55df2e1201b31717429b4c155b168/family1/2d3e39200c1d43fd8d892b147a03400a_SeqId_28_) 2023-03-11 22:55:53,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testMajorCompactionFromAdmin__s5diar14n0t93qesnkcnvnrtt0p9r9ikgnhncgklksgshmdols9vu1selc3ihp6b/family1/4fd4c651127c469fa182cbc93dd7f1fa 2023-03-11 22:55:53,738 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230311 table='testMajorCompactionFromAdmin' column='family1' 2023-03-11 22:55:53,739 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 22:55:53,740 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230311294407e13a894698b3e44fc13835256c to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230311294407e13a894698b3e44fc13835256c 2023-03-11 22:55:53,740 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023031174a1e0b8716246a59f23daf62a8bb655 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023031174a1e0b8716246a59f23daf62a8bb655 2023-03-11 22:55:53,741 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230311c49813ad3aaf4c71af35157984d87b7b to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230311c49813ad3aaf4c71af35157984d87b7b 2023-03-11 22:55:53,742 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230311f3dc8f91f52f4da283088dba727c68ce to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230311f3dc8f91f52f4da283088dba727c68ce 2023-03-11 22:55:53,742 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-03-11 22:55:53,742 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230311' 2023-03-11 22:55:53,743 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230311 for table='testMajorCompactionFromAdmin' and column='family1' 2023-03-11 22:55:53,743 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230311 for table='testMajorCompactionFromAdmin' and column='family1' 2023-03-11 22:55:54,289 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023031152f4ff0ade694d73a077767a8f623769 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023031152f4ff0ade694d73a077767a8f623769 2023-03-11 22:55:54,290 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230311 table='testMajorCompactionFromAdmin' column='family1' 2023-03-11 22:55:54,333 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230311/family1/226a7cb2be3d420e9bfe13f26a9c8214 first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x07] 2023-03-11 22:55:54,334 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionFromAdmin,2,1678575335623.1b0a50d6be32f97a1a81d7fd32d7f47b., hostname=jenkins-hbase20.apache.org,41843,1678575183185, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230311/family1/226a7cb2be3d420e9bfe13f26a9c8214}] 2023-03-11 22:55:54,335 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230311/family1/226a7cb2be3d420e9bfe13f26a9c8214 for inclusion in 1b0a50d6be32f97a1a81d7fd32d7f47b/family1 2023-03-11 22:55:54,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x07 2023-03-11 22:55:54,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.HStore(777): Region bounds: first=2 last= 2023-03-11 22:55:54,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.HRegion(2446): Flush status journal for 1b0a50d6be32f97a1a81d7fd32d7f47b: 2023-03-11 22:55:54,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230311/family1/226a7cb2be3d420e9bfe13f26a9c8214 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testMajorCompactionFromAdmin__ll8m6j1se1n0jgib4qfqkiar4erqemtvec5fgf9c0rpf9pjn0qdl1co8792c73gs/family1/226a7cb2be3d420e9bfe13f26a9c8214 2023-03-11 22:55:54,356 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testMajorCompactionFromAdmin__ll8m6j1se1n0jgib4qfqkiar4erqemtvec5fgf9c0rpf9pjn0qdl1co8792c73gs/family1/226a7cb2be3d420e9bfe13f26a9c8214 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/1b0a50d6be32f97a1a81d7fd32d7f47b/family1/2b6132cc7cbb4fe89a4eda9a83722784_SeqId_28_ 2023-03-11 22:55:54,356 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testMajorCompactionFromAdmin__ll8m6j1se1n0jgib4qfqkiar4erqemtvec5fgf9c0rpf9pjn0qdl1co8792c73gs/family1/226a7cb2be3d420e9bfe13f26a9c8214 into 1b0a50d6be32f97a1a81d7fd32d7f47b/family1 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/1b0a50d6be32f97a1a81d7fd32d7f47b/family1/2b6132cc7cbb4fe89a4eda9a83722784_SeqId_28_ - updating store file list. 2023-03-11 22:55:54,375 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/1b0a50d6be32f97a1a81d7fd32d7f47b/family1/2b6132cc7cbb4fe89a4eda9a83722784_SeqId_28_ into 1b0a50d6be32f97a1a81d7fd32d7f47b/family1 2023-03-11 22:55:54,375 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testMajorCompactionFromAdmin__ll8m6j1se1n0jgib4qfqkiar4erqemtvec5fgf9c0rpf9pjn0qdl1co8792c73gs/family1/226a7cb2be3d420e9bfe13f26a9c8214 into 1b0a50d6be32f97a1a81d7fd32d7f47b/family1 (new location: hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/1b0a50d6be32f97a1a81d7fd32d7f47b/family1/2b6132cc7cbb4fe89a4eda9a83722784_SeqId_28_) 2023-03-11 22:55:54,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testMajorCompactionFromAdmin__ll8m6j1se1n0jgib4qfqkiar4erqemtvec5fgf9c0rpf9pjn0qdl1co8792c73gs/family1/226a7cb2be3d420e9bfe13f26a9c8214 2023-03-11 22:55:54,377 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230311 table='testMajorCompactionFromAdmin' column='family1' 2023-03-11 22:55:54,378 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 22:55:54,379 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202303110211e401220e48b2a0a77496dfe9eaaf to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202303110211e401220e48b2a0a77496dfe9eaaf 2023-03-11 22:55:54,380 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202303111301d108b05b4cedb47b35cf878b0eeb to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202303111301d108b05b4cedb47b35cf878b0eeb 2023-03-11 22:55:54,380 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023031118a46bcd8ece4a02a5bc95bd48847132 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023031118a46bcd8ece4a02a5bc95bd48847132 2023-03-11 22:55:54,381 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230311394991127d564e59b0e4cdff655d0432 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230311394991127d564e59b0e4cdff655d0432 2023-03-11 22:55:54,381 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-03-11 22:55:54,381 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230311' 2023-03-11 22:55:54,381 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230311 for table='testMajorCompactionFromAdmin' and column='family1' 2023-03-11 22:55:54,382 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230311 for table='testMajorCompactionFromAdmin' and column='family1' 2023-03-11 22:55:55,098 DEBUG [regionserver/jenkins-hbase20:0.Chore.1] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.0, tune throughput to 50.00 MB/second 2023-03-11 22:55:55,351 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230311f3a86d9f3a5d4f99a7f79c3d223aa5c2 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230311f3a86d9f3a5d4f99a7f79c3d223aa5c2 2023-03-11 22:55:55,351 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230311 table='testMajorCompactionFromAdmin' column='family1' 2023-03-11 22:55:55,447 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230311/family1/1a1956499e8748b9854e6bf00e59508a first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x07] 2023-03-11 22:55:55,448 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionFromAdmin,,1678575335623.234c190ff73b29a4f3c5e6a6e630633f., hostname=jenkins-hbase20.apache.org,41843,1678575183185, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230311/family1/1a1956499e8748b9854e6bf00e59508a}] 2023-03-11 22:55:55,450 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230311/family1/1a1956499e8748b9854e6bf00e59508a for inclusion in 234c190ff73b29a4f3c5e6a6e630633f/family1 2023-03-11 22:55:55,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x07 2023-03-11 22:55:55,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.HStore(777): Region bounds: first= last=1 2023-03-11 22:55:55,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.HRegion(2446): Flush status journal for 234c190ff73b29a4f3c5e6a6e630633f: 2023-03-11 22:55:55,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230311/family1/1a1956499e8748b9854e6bf00e59508a to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testMajorCompactionFromAdmin__a9hr1ij0if7scngtsa8a72a0cjje28to2vbeqesuufee932j1hnlvlfavu2tj6e7/family1/1a1956499e8748b9854e6bf00e59508a 2023-03-11 22:55:55,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testMajorCompactionFromAdmin__a9hr1ij0if7scngtsa8a72a0cjje28to2vbeqesuufee932j1hnlvlfavu2tj6e7/family1/1a1956499e8748b9854e6bf00e59508a as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/234c190ff73b29a4f3c5e6a6e630633f/family1/1d974050f7514a1dbd2bffb00b64b3cc_SeqId_28_ 2023-03-11 22:55:55,489 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testMajorCompactionFromAdmin__a9hr1ij0if7scngtsa8a72a0cjje28to2vbeqesuufee932j1hnlvlfavu2tj6e7/family1/1a1956499e8748b9854e6bf00e59508a into 234c190ff73b29a4f3c5e6a6e630633f/family1 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/234c190ff73b29a4f3c5e6a6e630633f/family1/1d974050f7514a1dbd2bffb00b64b3cc_SeqId_28_ - updating store file list. 2023-03-11 22:55:55,525 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/234c190ff73b29a4f3c5e6a6e630633f/family1/1d974050f7514a1dbd2bffb00b64b3cc_SeqId_28_ into 234c190ff73b29a4f3c5e6a6e630633f/family1 2023-03-11 22:55:55,526 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testMajorCompactionFromAdmin__a9hr1ij0if7scngtsa8a72a0cjje28to2vbeqesuufee932j1hnlvlfavu2tj6e7/family1/1a1956499e8748b9854e6bf00e59508a into 234c190ff73b29a4f3c5e6a6e630633f/family1 (new location: hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/234c190ff73b29a4f3c5e6a6e630633f/family1/1d974050f7514a1dbd2bffb00b64b3cc_SeqId_28_) 2023-03-11 22:55:55,526 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41843] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/staging/jenkins__testMajorCompactionFromAdmin__a9hr1ij0if7scngtsa8a72a0cjje28to2vbeqesuufee932j1hnlvlfavu2tj6e7/family1/1a1956499e8748b9854e6bf00e59508a 2023-03-11 22:55:55,528 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230311 table='testMajorCompactionFromAdmin' column='family1' 2023-03-11 22:55:55,528 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 22:55:55,530 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202303117b1d19bfe59d43128d70fd1e2a92a524 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202303117b1d19bfe59d43128d70fd1e2a92a524 2023-03-11 22:55:55,534 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230311ad9f4cf547fb40c592e258a5e9d620a4 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230311ad9f4cf547fb40c592e258a5e9d620a4 2023-03-11 22:55:55,535 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230311d75c0872f31a49639a4e7de17c301992 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230311d75c0872f31a49639a4e7de17c301992 2023-03-11 22:55:55,536 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230311dd80d5d9efea46968347b44fb0cbd549 to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230311dd80d5d9efea46968347b44fb0cbd549 2023-03-11 22:55:55,536 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-03-11 22:55:55,536 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230311' 2023-03-11 22:55:55,537 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230311 for table='testMajorCompactionFromAdmin' and column='family1' 2023-03-11 22:55:55,537 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testMajorCompactionFromAdmin' column='family1' 2023-03-11 22:55:55,537 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] compactions.PartitionedMobCompactor(364): After a mob compaction with all files selected, archiving the del files for table='testMajorCompactionFromAdmin' and column='family1' 2023-03-11 22:55:55,537 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] compactions.PartitionedMobCompactor(367): [hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023031175cd6bab16a14864ba00c974788dc711_del] 2023-03-11 22:55:55,537 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 22:55:55,538 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023031175cd6bab16a14864ba00c974788dc711_del to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023031175cd6bab16a14864ba00c974788dc711_del 2023-03-11 22:55:55,539 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-03-11 22:55:55,539 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] compactions.PartitionedMobCompactor(367): [hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202303114a2c227dac9749368edd0e20455989c0_del] 2023-03-11 22:55:55,539 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 22:55:55,540 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202303114a2c227dac9749368edd0e20455989c0_del to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202303114a2c227dac9749368edd0e20455989c0_del 2023-03-11 22:55:55,540 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-03-11 22:55:55,540 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] compactions.PartitionedMobCompactor(367): [hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230311c72ee1c50cb64e9ea424da257ff27b3c_del] 2023-03-11 22:55:55,540 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] backup.HFileArchiver(360): Archiving compacted files. 2023-03-11 22:55:55,541 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230311c72ee1c50cb64e9ea424da257ff27b3c_del to hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230311c72ee1c50cb64e9ea424da257ff27b3c_del 2023-03-11 22:55:55,542 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-03-11 22:55:55,542 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678575187465] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionFromAdmin', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-11 22:55:55,543 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=123, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-03-11 22:55:55,544 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=123, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE in 3.2160 sec 2023-03-11 22:55:55,565 DEBUG [Listener at localhost.localdomain/41563] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-11 22:55:55,568 DEBUG [Listener at localhost.localdomain/41563] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-11 22:55:55,571 DEBUG [Listener at localhost.localdomain/41563] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-11 22:55:55,572 DEBUG [Listener at localhost.localdomain/41563] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-11 22:55:55,577 INFO [Listener at localhost.localdomain/41563] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-03-11 22:55:55,608 INFO [Listener at localhost.localdomain/41563] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionFromAdmin Thread=245 (was 255), OpenFileDescriptor=638 (was 642), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=221 (was 151) - SystemLoadAverage LEAK? -, ProcessCount=166 (was 168), AvailableMemoryMB=22480 (was 22557) 2023-03-11 22:55:55,609 DEBUG [Listener at localhost.localdomain/41563] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5849430e to 127.0.0.1:51815 2023-03-11 22:55:55,609 DEBUG [Listener at localhost.localdomain/41563] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-11 22:55:55,609 INFO [Listener at localhost.localdomain/41563] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-03-11 22:55:55,609 INFO [Listener at localhost.localdomain/41563] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-11 22:55:55,609 DEBUG [Listener at localhost.localdomain/41563] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x54237440 to 127.0.0.1:51815 2023-03-11 22:55:55,609 DEBUG [Listener at localhost.localdomain/41563] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-11 22:55:55,610 DEBUG [Listener at localhost.localdomain/41563] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-03-11 22:55:55,610 DEBUG [Listener at localhost.localdomain/41563] util.JVMClusterUtil(257): Found active master hash=1610495626, stopped=false 2023-03-11 22:55:55,610 INFO [Listener at localhost.localdomain/41563] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase20.apache.org,44347,1678575181988 2023-03-11 22:55:55,611 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-03-11 22:55:55,611 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-03-11 22:55:55,611 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-03-11 22:55:55,611 INFO [Listener at localhost.localdomain/41563] procedure2.ProcedureExecutor(629): Stopping 2023-03-11 22:55:55,611 DEBUG [Listener at localhost.localdomain/41563] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7134dec7 to 127.0.0.1:51815 2023-03-11 22:55:55,611 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-03-11 22:55:55,611 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-03-11 22:55:55,611 DEBUG [Listener at localhost.localdomain/41563] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-11 22:55:55,611 INFO [Listener at localhost.localdomain/41563] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase20.apache.org,41843,1678575183185' ***** 2023-03-11 22:55:55,611 INFO [Listener at localhost.localdomain/41563] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-03-11 22:55:55,612 INFO [RS:0;jenkins-hbase20:41843] regionserver.HeapMemoryManager(220): Stopping 2023-03-11 22:55:55,612 INFO [RS:0;jenkins-hbase20:41843] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-03-11 22:55:55,612 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-03-11 22:55:55,612 INFO [RS:0;jenkins-hbase20:41843] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-03-11 22:55:55,612 INFO [RS:0;jenkins-hbase20:41843] regionserver.HRegionServer(3304): Received CLOSE for 616fda1710f6e641a6e510cc06f7f66d 2023-03-11 22:55:55,613 INFO [RS:0;jenkins-hbase20:41843] regionserver.HRegionServer(3304): Received CLOSE for 8bff51e742e5ddadbd357b4ea853b5d8 2023-03-11 22:55:55,613 INFO [RS:0;jenkins-hbase20:41843] regionserver.HRegionServer(3304): Received CLOSE for 62d6e77362816ea2765a04331be018cd 2023-03-11 22:55:55,613 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 616fda1710f6e641a6e510cc06f7f66d, disabling compactions & flushes 2023-03-11 22:55:55,613 INFO [RS:0;jenkins-hbase20:41843] regionserver.HRegionServer(3304): Received CLOSE for 7189059ae0acaaffd2a7e63414af38f7 2023-03-11 22:55:55,613 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithMonthlyPolicy,,1678575201009.616fda1710f6e641a6e510cc06f7f66d. 2023-03-11 22:55:55,613 INFO [RS:0;jenkins-hbase20:41843] regionserver.HRegionServer(3304): Received CLOSE for 1b0a50d6be32f97a1a81d7fd32d7f47b 2023-03-11 22:55:55,613 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithMonthlyPolicy,,1678575201009.616fda1710f6e641a6e510cc06f7f66d. 2023-03-11 22:55:55,613 INFO [RS:0;jenkins-hbase20:41843] regionserver.HRegionServer(3304): Received CLOSE for f5ff2dc2c8d65f11f0ecb2681def8a43 2023-03-11 22:55:55,613 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithMonthlyPolicy,,1678575201009.616fda1710f6e641a6e510cc06f7f66d. after waiting 0 ms 2023-03-11 22:55:55,613 INFO [RS:0;jenkins-hbase20:41843] regionserver.HRegionServer(3304): Received CLOSE for 7087f753e6d78287d81e1391b6bb5914 2023-03-11 22:55:55,613 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithMonthlyPolicy,,1678575201009.616fda1710f6e641a6e510cc06f7f66d. 2023-03-11 22:55:55,613 INFO [RS:0;jenkins-hbase20:41843] regionserver.HRegionServer(3304): Received CLOSE for 2bd54e0456c101f274068eb0eb037545 2023-03-11 22:55:55,613 INFO [RS:0;jenkins-hbase20:41843] regionserver.HRegionServer(3304): Received CLOSE for db89d2511291454c79f34c24761dad32 2023-03-11 22:55:55,613 INFO [RS:0;jenkins-hbase20:41843] regionserver.HRegionServer(3304): Received CLOSE for 7a35b3ad186d84bd239e22f355d22d96 2023-03-11 22:55:55,613 INFO [RS:0;jenkins-hbase20:41843] regionserver.HRegionServer(3304): Received CLOSE for 3d226077141bc04cbf67ba56ac0d4e3c 2023-03-11 22:55:55,613 INFO [RS:0;jenkins-hbase20:41843] regionserver.HRegionServer(3304): Received CLOSE for 1d03ff70922c0981304d6eab43d86f2b 2023-03-11 22:55:55,613 INFO [RS:0;jenkins-hbase20:41843] regionserver.HRegionServer(3304): Received CLOSE for c9557b829346f7133c6ea3c6c1b42236 2023-03-11 22:55:55,614 INFO [RS:0;jenkins-hbase20:41843] regionserver.HRegionServer(3304): Received CLOSE for 234c190ff73b29a4f3c5e6a6e630633f 2023-03-11 22:55:55,614 INFO [RS:0;jenkins-hbase20:41843] regionserver.HRegionServer(3304): Received CLOSE for 84e7ece417189721cd2d8b7121fcfa8d 2023-03-11 22:55:55,614 INFO [RS:0;jenkins-hbase20:41843] regionserver.HRegionServer(3304): Received CLOSE for 39bbacab0d97c013b0afb55b77408936 2023-03-11 22:55:55,614 INFO [RS:0;jenkins-hbase20:41843] regionserver.HRegionServer(3304): Received CLOSE for aa39ddf65a193cbb3b88f447adacec76 2023-03-11 22:55:55,614 INFO [RS:0;jenkins-hbase20:41843] regionserver.HRegionServer(3304): Received CLOSE for 5cb27d102005ece125b41111cbb6d846 2023-03-11 22:55:55,614 INFO [RS:0;jenkins-hbase20:41843] regionserver.HRegionServer(3304): Received CLOSE for b1b55df2e1201b31717429b4c155b168 2023-03-11 22:55:55,614 INFO [RS:0;jenkins-hbase20:41843] regionserver.HRegionServer(3304): Received CLOSE for 078337168df669f0c39d86df4d8f6540 2023-03-11 22:55:55,614 INFO [RS:0;jenkins-hbase20:41843] regionserver.HRegionServer(1145): stopping server jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:55,614 DEBUG [RS:0;jenkins-hbase20:41843] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x05755a37 to 127.0.0.1:51815 2023-03-11 22:55:55,614 DEBUG [RS:0;jenkins-hbase20:41843] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-11 22:55:55,614 INFO [RS:0;jenkins-hbase20:41843] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-03-11 22:55:55,615 INFO [RS:0;jenkins-hbase20:41843] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-03-11 22:55:55,615 INFO [RS:0;jenkins-hbase20:41843] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-03-11 22:55:55,615 INFO [RS:0;jenkins-hbase20:41843] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-03-11 22:55:55,615 INFO [RS:0;jenkins-hbase20:41843] regionserver.HRegionServer(1475): Waiting on 21 regions to close 2023-03-11 22:55:55,615 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-03-11 22:55:55,615 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-03-11 22:55:55,615 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-03-11 22:55:55,615 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-03-11 22:55:55,615 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-03-11 22:55:55,615 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=50.62 KB heapSize=78.23 KB 2023-03-11 22:55:55,616 DEBUG [RS:0;jenkins-hbase20:41843] regionserver.HRegionServer(1505): Waiting on 078337168df669f0c39d86df4d8f6540, 1588230740, 1b0a50d6be32f97a1a81d7fd32d7f47b, 1d03ff70922c0981304d6eab43d86f2b, 234c190ff73b29a4f3c5e6a6e630633f, 2bd54e0456c101f274068eb0eb037545, 39bbacab0d97c013b0afb55b77408936, 3d226077141bc04cbf67ba56ac0d4e3c, 5cb27d102005ece125b41111cbb6d846, 616fda1710f6e641a6e510cc06f7f66d, 62d6e77362816ea2765a04331be018cd, 7087f753e6d78287d81e1391b6bb5914, 7189059ae0acaaffd2a7e63414af38f7, 7a35b3ad186d84bd239e22f355d22d96, 84e7ece417189721cd2d8b7121fcfa8d, 8bff51e742e5ddadbd357b4ea853b5d8, aa39ddf65a193cbb3b88f447adacec76, b1b55df2e1201b31717429b4c155b168, c9557b829346f7133c6ea3c6c1b42236, db89d2511291454c79f34c24761dad32, f5ff2dc2c8d65f11f0ecb2681def8a43 2023-03-11 22:55:55,617 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithMonthlyPolicy/616fda1710f6e641a6e510cc06f7f66d/recovered.edits/52.seqid, newMaxSeqId=52, maxSeqId=1 2023-03-11 22:55:55,618 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithMonthlyPolicy,,1678575201009.616fda1710f6e641a6e510cc06f7f66d. 2023-03-11 22:55:55,618 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 616fda1710f6e641a6e510cc06f7f66d: 2023-03-11 22:55:55,618 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithMonthlyPolicy,,1678575201009.616fda1710f6e641a6e510cc06f7f66d. 2023-03-11 22:55:55,618 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 8bff51e742e5ddadbd357b4ea853b5d8, disabling compactions & flushes 2023-03-11 22:55:55,618 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,2,1678575223634.8bff51e742e5ddadbd357b4ea853b5d8. 2023-03-11 22:55:55,618 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,2,1678575223634.8bff51e742e5ddadbd357b4ea853b5d8. 2023-03-11 22:55:55,619 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,2,1678575223634.8bff51e742e5ddadbd357b4ea853b5d8. after waiting 0 ms 2023-03-11 22:55:55,619 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,2,1678575223634.8bff51e742e5ddadbd357b4ea853b5d8. 2023-03-11 22:55:55,626 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testScannerOnBulkLoadRefHFiles/8bff51e742e5ddadbd357b4ea853b5d8/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=1 2023-03-11 22:55:55,628 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,2,1678575223634.8bff51e742e5ddadbd357b4ea853b5d8. 2023-03-11 22:55:55,628 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 8bff51e742e5ddadbd357b4ea853b5d8: 2023-03-11 22:55:55,628 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,2,1678575223634.8bff51e742e5ddadbd357b4ea853b5d8. 2023-03-11 22:55:55,628 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 62d6e77362816ea2765a04331be018cd, disabling compactions & flushes 2023-03-11 22:55:55,628 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1678575185937.62d6e77362816ea2765a04331be018cd. 2023-03-11 22:55:55,628 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1678575185937.62d6e77362816ea2765a04331be018cd. 2023-03-11 22:55:55,628 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1678575185937.62d6e77362816ea2765a04331be018cd. after waiting 0 ms 2023-03-11 22:55:55,628 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1678575185937.62d6e77362816ea2765a04331be018cd. 2023-03-11 22:55:55,628 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing 62d6e77362816ea2765a04331be018cd 1/1 column families, dataSize=109 B heapSize=592 B 2023-03-11 22:55:55,669 INFO [regionserver/jenkins-hbase20:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactedHFilesCleaner was stopped 2023-03-11 22:55:55,685 INFO [regionserver/jenkins-hbase20:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-03-11 22:55:55,816 DEBUG [RS:0;jenkins-hbase20:41843] regionserver.HRegionServer(1505): Waiting on 078337168df669f0c39d86df4d8f6540, 1588230740, 1b0a50d6be32f97a1a81d7fd32d7f47b, 1d03ff70922c0981304d6eab43d86f2b, 234c190ff73b29a4f3c5e6a6e630633f, 2bd54e0456c101f274068eb0eb037545, 39bbacab0d97c013b0afb55b77408936, 3d226077141bc04cbf67ba56ac0d4e3c, 5cb27d102005ece125b41111cbb6d846, 62d6e77362816ea2765a04331be018cd, 7087f753e6d78287d81e1391b6bb5914, 7189059ae0acaaffd2a7e63414af38f7, 7a35b3ad186d84bd239e22f355d22d96, 84e7ece417189721cd2d8b7121fcfa8d, aa39ddf65a193cbb3b88f447adacec76, b1b55df2e1201b31717429b4c155b168, c9557b829346f7133c6ea3c6c1b42236, db89d2511291454c79f34c24761dad32, f5ff2dc2c8d65f11f0ecb2681def8a43 2023-03-11 22:55:56,016 DEBUG [RS:0;jenkins-hbase20:41843] regionserver.HRegionServer(1505): Waiting on 078337168df669f0c39d86df4d8f6540, 1588230740, 1b0a50d6be32f97a1a81d7fd32d7f47b, 1d03ff70922c0981304d6eab43d86f2b, 234c190ff73b29a4f3c5e6a6e630633f, 2bd54e0456c101f274068eb0eb037545, 39bbacab0d97c013b0afb55b77408936, 3d226077141bc04cbf67ba56ac0d4e3c, 5cb27d102005ece125b41111cbb6d846, 62d6e77362816ea2765a04331be018cd, 7087f753e6d78287d81e1391b6bb5914, 7189059ae0acaaffd2a7e63414af38f7, 7a35b3ad186d84bd239e22f355d22d96, 84e7ece417189721cd2d8b7121fcfa8d, aa39ddf65a193cbb3b88f447adacec76, b1b55df2e1201b31717429b4c155b168, c9557b829346f7133c6ea3c6c1b42236, db89d2511291454c79f34c24761dad32, f5ff2dc2c8d65f11f0ecb2681def8a43 2023-03-11 22:55:56,029 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=48.34 KB at sequenceid=130 (bloomFilter=false), to=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/hbase/meta/1588230740/.tmp/info/118094362c22456fb0ec12b5794f8a57 2023-03-11 22:55:56,032 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 118094362c22456fb0ec12b5794f8a57 2023-03-11 22:55:56,033 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=109 B at sequenceid=7 (bloomFilter=true), to=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/hbase/namespace/62d6e77362816ea2765a04331be018cd/.tmp/info/e790302845fa4b6991098765912ac83e 2023-03-11 22:55:56,038 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/hbase/namespace/62d6e77362816ea2765a04331be018cd/.tmp/info/e790302845fa4b6991098765912ac83e as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/hbase/namespace/62d6e77362816ea2765a04331be018cd/info/e790302845fa4b6991098765912ac83e 2023-03-11 22:55:56,041 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=102 B at sequenceid=130 (bloomFilter=false), to=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/hbase/meta/1588230740/.tmp/rep_barrier/418eb595ba124e818f1597a11d96cd0f 2023-03-11 22:55:56,045 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 418eb595ba124e818f1597a11d96cd0f 2023-03-11 22:55:56,045 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/hbase/namespace/62d6e77362816ea2765a04331be018cd/info/e790302845fa4b6991098765912ac83e, entries=3, sequenceid=7, filesize=4.8 K 2023-03-11 22:55:56,046 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~109 B/109, heapSize ~576 B/576, currentSize=0 B/0 for 62d6e77362816ea2765a04331be018cd in 418ms, sequenceid=7, compaction requested=false 2023-03-11 22:55:56,051 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/hbase/namespace/62d6e77362816ea2765a04331be018cd/recovered.edits/10.seqid, newMaxSeqId=10, maxSeqId=1 2023-03-11 22:55:56,052 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1678575185937.62d6e77362816ea2765a04331be018cd. 2023-03-11 22:55:56,052 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 62d6e77362816ea2765a04331be018cd: 2023-03-11 22:55:56,052 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1678575185937.62d6e77362816ea2765a04331be018cd. 2023-03-11 22:55:56,052 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 7189059ae0acaaffd2a7e63414af38f7, disabling compactions & flushes 2023-03-11 22:55:56,052 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1678575280100.7189059ae0acaaffd2a7e63414af38f7. 2023-03-11 22:55:56,052 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1678575280100.7189059ae0acaaffd2a7e63414af38f7. 2023-03-11 22:55:56,053 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1678575280100.7189059ae0acaaffd2a7e63414af38f7. after waiting 0 ms 2023-03-11 22:55:56,053 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1678575280100.7189059ae0acaaffd2a7e63414af38f7. 2023-03-11 22:55:56,056 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/7189059ae0acaaffd2a7e63414af38f7/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-03-11 22:55:56,057 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1678575280100.7189059ae0acaaffd2a7e63414af38f7. 2023-03-11 22:55:56,057 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 7189059ae0acaaffd2a7e63414af38f7: 2023-03-11 22:55:56,057 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,2,1678575280100.7189059ae0acaaffd2a7e63414af38f7. 2023-03-11 22:55:56,057 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 1b0a50d6be32f97a1a81d7fd32d7f47b, disabling compactions & flushes 2023-03-11 22:55:56,057 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,2,1678575335623.1b0a50d6be32f97a1a81d7fd32d7f47b. 2023-03-11 22:55:56,057 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,2,1678575335623.1b0a50d6be32f97a1a81d7fd32d7f47b. 2023-03-11 22:55:56,057 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,2,1678575335623.1b0a50d6be32f97a1a81d7fd32d7f47b. after waiting 0 ms 2023-03-11 22:55:56,057 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,2,1678575335623.1b0a50d6be32f97a1a81d7fd32d7f47b. 2023-03-11 22:55:56,060 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/1b0a50d6be32f97a1a81d7fd32d7f47b/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-03-11 22:55:56,061 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,2,1678575335623.1b0a50d6be32f97a1a81d7fd32d7f47b. 2023-03-11 22:55:56,061 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 1b0a50d6be32f97a1a81d7fd32d7f47b: 2023-03-11 22:55:56,061 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,2,1678575335623.1b0a50d6be32f97a1a81d7fd32d7f47b. 2023-03-11 22:55:56,061 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing f5ff2dc2c8d65f11f0ecb2681def8a43, disabling compactions & flushes 2023-03-11 22:55:56,061 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1678575280100.f5ff2dc2c8d65f11f0ecb2681def8a43. 2023-03-11 22:55:56,061 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1678575280100.f5ff2dc2c8d65f11f0ecb2681def8a43. 2023-03-11 22:55:56,061 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1678575280100.f5ff2dc2c8d65f11f0ecb2681def8a43. after waiting 0 ms 2023-03-11 22:55:56,061 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1678575280100.f5ff2dc2c8d65f11f0ecb2681def8a43. 2023-03-11 22:55:56,065 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/f5ff2dc2c8d65f11f0ecb2681def8a43/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-03-11 22:55:56,066 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1678575280100.f5ff2dc2c8d65f11f0ecb2681def8a43. 2023-03-11 22:55:56,066 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for f5ff2dc2c8d65f11f0ecb2681def8a43: 2023-03-11 22:55:56,066 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,,1678575280100.f5ff2dc2c8d65f11f0ecb2681def8a43. 2023-03-11 22:55:56,066 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 7087f753e6d78287d81e1391b6bb5914, disabling compactions & flushes 2023-03-11 22:55:56,066 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,1,1678575308200.7087f753e6d78287d81e1391b6bb5914. 2023-03-11 22:55:56,066 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,1,1678575308200.7087f753e6d78287d81e1391b6bb5914. 2023-03-11 22:55:56,066 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,1,1678575308200.7087f753e6d78287d81e1391b6bb5914. after waiting 0 ms 2023-03-11 22:55:56,066 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,1,1678575308200.7087f753e6d78287d81e1391b6bb5914. 2023-03-11 22:55:56,072 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/7087f753e6d78287d81e1391b6bb5914/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-03-11 22:55:56,073 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,1,1678575308200.7087f753e6d78287d81e1391b6bb5914. 2023-03-11 22:55:56,073 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 7087f753e6d78287d81e1391b6bb5914: 2023-03-11 22:55:56,073 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,1,1678575308200.7087f753e6d78287d81e1391b6bb5914. 2023-03-11 22:55:56,073 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 2bd54e0456c101f274068eb0eb037545, disabling compactions & flushes 2023-03-11 22:55:56,073 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,1,1678575223634.2bd54e0456c101f274068eb0eb037545. 2023-03-11 22:55:56,073 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,1,1678575223634.2bd54e0456c101f274068eb0eb037545. 2023-03-11 22:55:56,073 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,1,1678575223634.2bd54e0456c101f274068eb0eb037545. after waiting 0 ms 2023-03-11 22:55:56,073 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,1,1678575223634.2bd54e0456c101f274068eb0eb037545. 2023-03-11 22:55:56,079 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testScannerOnBulkLoadRefHFiles/2bd54e0456c101f274068eb0eb037545/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-03-11 22:55:56,080 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,1,1678575223634.2bd54e0456c101f274068eb0eb037545. 2023-03-11 22:55:56,080 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 2bd54e0456c101f274068eb0eb037545: 2023-03-11 22:55:56,080 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,1,1678575223634.2bd54e0456c101f274068eb0eb037545. 2023-03-11 22:55:56,080 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing db89d2511291454c79f34c24761dad32, disabling compactions & flushes 2023-03-11 22:55:56,080 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678575258760.db89d2511291454c79f34c24761dad32. 2023-03-11 22:55:56,080 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678575258760.db89d2511291454c79f34c24761dad32. 2023-03-11 22:55:56,080 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678575258760.db89d2511291454c79f34c24761dad32. after waiting 0 ms 2023-03-11 22:55:56,080 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678575258760.db89d2511291454c79f34c24761dad32. 2023-03-11 22:55:56,083 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/db89d2511291454c79f34c24761dad32/recovered.edits/58.seqid, newMaxSeqId=58, maxSeqId=55 2023-03-11 22:55:56,084 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678575258760.db89d2511291454c79f34c24761dad32. 2023-03-11 22:55:56,084 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for db89d2511291454c79f34c24761dad32: 2023-03-11 22:55:56,084 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678575258760.db89d2511291454c79f34c24761dad32. 2023-03-11 22:55:56,084 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 7a35b3ad186d84bd239e22f355d22d96, disabling compactions & flushes 2023-03-11 22:55:56,084 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithWeeklyPolicy,,1678575211483.7a35b3ad186d84bd239e22f355d22d96. 2023-03-11 22:55:56,085 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithWeeklyPolicy,,1678575211483.7a35b3ad186d84bd239e22f355d22d96. 2023-03-11 22:55:56,085 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithWeeklyPolicy,,1678575211483.7a35b3ad186d84bd239e22f355d22d96. after waiting 0 ms 2023-03-11 22:55:56,085 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithWeeklyPolicy,,1678575211483.7a35b3ad186d84bd239e22f355d22d96. 2023-03-11 22:55:56,087 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithWeeklyPolicy/7a35b3ad186d84bd239e22f355d22d96/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-03-11 22:55:56,088 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMinorCompactionWithWeeklyPolicy,,1678575211483.7a35b3ad186d84bd239e22f355d22d96. 2023-03-11 22:55:56,088 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 7a35b3ad186d84bd239e22f355d22d96: 2023-03-11 22:55:56,088 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMinorCompactionWithWeeklyPolicy,,1678575211483.7a35b3ad186d84bd239e22f355d22d96. 2023-03-11 22:55:56,088 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 3d226077141bc04cbf67ba56ac0d4e3c, disabling compactions & flushes 2023-03-11 22:55:56,089 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyPolicy,,1678575228692.3d226077141bc04cbf67ba56ac0d4e3c. 2023-03-11 22:55:56,089 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyPolicy,,1678575228692.3d226077141bc04cbf67ba56ac0d4e3c. 2023-03-11 22:55:56,089 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyPolicy,,1678575228692.3d226077141bc04cbf67ba56ac0d4e3c. after waiting 0 ms 2023-03-11 22:55:56,089 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyPolicy,,1678575228692.3d226077141bc04cbf67ba56ac0d4e3c. 2023-03-11 22:55:56,091 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyPolicy/3d226077141bc04cbf67ba56ac0d4e3c/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-03-11 22:55:56,092 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyPolicy,,1678575228692.3d226077141bc04cbf67ba56ac0d4e3c. 2023-03-11 22:55:56,092 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 3d226077141bc04cbf67ba56ac0d4e3c: 2023-03-11 22:55:56,092 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyPolicy,,1678575228692.3d226077141bc04cbf67ba56ac0d4e3c. 2023-03-11 22:55:56,092 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 1d03ff70922c0981304d6eab43d86f2b, disabling compactions & flushes 2023-03-11 22:55:56,092 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,,1678575308200.1d03ff70922c0981304d6eab43d86f2b. 2023-03-11 22:55:56,092 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,,1678575308200.1d03ff70922c0981304d6eab43d86f2b. 2023-03-11 22:55:56,092 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,,1678575308200.1d03ff70922c0981304d6eab43d86f2b. after waiting 0 ms 2023-03-11 22:55:56,092 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,,1678575308200.1d03ff70922c0981304d6eab43d86f2b. 2023-03-11 22:55:56,095 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/1d03ff70922c0981304d6eab43d86f2b/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-03-11 22:55:56,096 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,,1678575308200.1d03ff70922c0981304d6eab43d86f2b. 2023-03-11 22:55:56,096 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 1d03ff70922c0981304d6eab43d86f2b: 2023-03-11 22:55:56,096 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,,1678575308200.1d03ff70922c0981304d6eab43d86f2b. 2023-03-11 22:55:56,096 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing c9557b829346f7133c6ea3c6c1b42236, disabling compactions & flushes 2023-03-11 22:55:56,096 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1678575280100.c9557b829346f7133c6ea3c6c1b42236. 2023-03-11 22:55:56,096 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1678575280100.c9557b829346f7133c6ea3c6c1b42236. 2023-03-11 22:55:56,096 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1678575280100.c9557b829346f7133c6ea3c6c1b42236. after waiting 0 ms 2023-03-11 22:55:56,096 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1678575280100.c9557b829346f7133c6ea3c6c1b42236. 2023-03-11 22:55:56,099 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testCompactionWithHFileLink/c9557b829346f7133c6ea3c6c1b42236/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-03-11 22:55:56,101 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1678575280100.c9557b829346f7133c6ea3c6c1b42236. 2023-03-11 22:55:56,101 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for c9557b829346f7133c6ea3c6c1b42236: 2023-03-11 22:55:56,101 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,1,1678575280100.c9557b829346f7133c6ea3c6c1b42236. 2023-03-11 22:55:56,101 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 234c190ff73b29a4f3c5e6a6e630633f, disabling compactions & flushes 2023-03-11 22:55:56,101 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,,1678575335623.234c190ff73b29a4f3c5e6a6e630633f. 2023-03-11 22:55:56,101 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,,1678575335623.234c190ff73b29a4f3c5e6a6e630633f. 2023-03-11 22:55:56,101 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,,1678575335623.234c190ff73b29a4f3c5e6a6e630633f. after waiting 0 ms 2023-03-11 22:55:56,101 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,,1678575335623.234c190ff73b29a4f3c5e6a6e630633f. 2023-03-11 22:55:56,104 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/234c190ff73b29a4f3c5e6a6e630633f/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-03-11 22:55:56,104 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,,1678575335623.234c190ff73b29a4f3c5e6a6e630633f. 2023-03-11 22:55:56,104 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 234c190ff73b29a4f3c5e6a6e630633f: 2023-03-11 22:55:56,105 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,,1678575335623.234c190ff73b29a4f3c5e6a6e630633f. 2023-03-11 22:55:56,105 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 84e7ece417189721cd2d8b7121fcfa8d, disabling compactions & flushes 2023-03-11 22:55:56,105 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,2,1678575308200.84e7ece417189721cd2d8b7121fcfa8d. 2023-03-11 22:55:56,105 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,2,1678575308200.84e7ece417189721cd2d8b7121fcfa8d. 2023-03-11 22:55:56,105 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,2,1678575308200.84e7ece417189721cd2d8b7121fcfa8d. after waiting 0 ms 2023-03-11 22:55:56,105 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,2,1678575308200.84e7ece417189721cd2d8b7121fcfa8d. 2023-03-11 22:55:56,107 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/ns/testMinorCompaction/84e7ece417189721cd2d8b7121fcfa8d/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-03-11 22:55:56,108 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,2,1678575308200.84e7ece417189721cd2d8b7121fcfa8d. 2023-03-11 22:55:56,108 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 84e7ece417189721cd2d8b7121fcfa8d: 2023-03-11 22:55:56,108 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,2,1678575308200.84e7ece417189721cd2d8b7121fcfa8d. 2023-03-11 22:55:56,108 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 39bbacab0d97c013b0afb55b77408936, disabling compactions & flushes 2023-03-11 22:55:56,108 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1678575187642.39bbacab0d97c013b0afb55b77408936. 2023-03-11 22:55:56,108 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1678575187642.39bbacab0d97c013b0afb55b77408936. 2023-03-11 22:55:56,108 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1678575187642.39bbacab0d97c013b0afb55b77408936. after waiting 0 ms 2023-03-11 22:55:56,108 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1678575187642.39bbacab0d97c013b0afb55b77408936. 2023-03-11 22:55:56,114 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/39bbacab0d97c013b0afb55b77408936/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-03-11 22:55:56,114 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1678575187642.39bbacab0d97c013b0afb55b77408936. 2023-03-11 22:55:56,114 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 39bbacab0d97c013b0afb55b77408936: 2023-03-11 22:55:56,114 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1678575187642.39bbacab0d97c013b0afb55b77408936. 2023-03-11 22:55:56,115 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing aa39ddf65a193cbb3b88f447adacec76, disabling compactions & flushes 2023-03-11 22:55:56,115 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678575242278.aa39ddf65a193cbb3b88f447adacec76. 2023-03-11 22:55:56,115 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678575242278.aa39ddf65a193cbb3b88f447adacec76. 2023-03-11 22:55:56,115 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678575242278.aa39ddf65a193cbb3b88f447adacec76. after waiting 0 ms 2023-03-11 22:55:56,115 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678575242278.aa39ddf65a193cbb3b88f447adacec76. 2023-03-11 22:55:56,118 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/aa39ddf65a193cbb3b88f447adacec76/recovered.edits/58.seqid, newMaxSeqId=58, maxSeqId=55 2023-03-11 22:55:56,118 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678575242278.aa39ddf65a193cbb3b88f447adacec76. 2023-03-11 22:55:56,118 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for aa39ddf65a193cbb3b88f447adacec76: 2023-03-11 22:55:56,118 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678575242278.aa39ddf65a193cbb3b88f447adacec76. 2023-03-11 22:55:56,118 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 5cb27d102005ece125b41111cbb6d846, disabling compactions & flushes 2023-03-11 22:55:56,118 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithMonthlyPolicy,,1678575322911.5cb27d102005ece125b41111cbb6d846. 2023-03-11 22:55:56,118 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithMonthlyPolicy,,1678575322911.5cb27d102005ece125b41111cbb6d846. 2023-03-11 22:55:56,118 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithMonthlyPolicy,,1678575322911.5cb27d102005ece125b41111cbb6d846. after waiting 0 ms 2023-03-11 22:55:56,118 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithMonthlyPolicy,,1678575322911.5cb27d102005ece125b41111cbb6d846. 2023-03-11 22:55:56,121 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMinorCompactionWithMonthlyPolicy/5cb27d102005ece125b41111cbb6d846/recovered.edits/52.seqid, newMaxSeqId=52, maxSeqId=1 2023-03-11 22:55:56,121 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMinorCompactionWithMonthlyPolicy,,1678575322911.5cb27d102005ece125b41111cbb6d846. 2023-03-11 22:55:56,121 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 5cb27d102005ece125b41111cbb6d846: 2023-03-11 22:55:56,121 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMinorCompactionWithMonthlyPolicy,,1678575322911.5cb27d102005ece125b41111cbb6d846. 2023-03-11 22:55:56,122 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing b1b55df2e1201b31717429b4c155b168, disabling compactions & flushes 2023-03-11 22:55:56,122 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,1,1678575335623.b1b55df2e1201b31717429b4c155b168. 2023-03-11 22:55:56,122 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,1,1678575335623.b1b55df2e1201b31717429b4c155b168. 2023-03-11 22:55:56,122 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,1,1678575335623.b1b55df2e1201b31717429b4c155b168. after waiting 0 ms 2023-03-11 22:55:56,122 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,1,1678575335623.b1b55df2e1201b31717429b4c155b168. 2023-03-11 22:55:56,125 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testMajorCompactionFromAdmin/b1b55df2e1201b31717429b4c155b168/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-03-11 22:55:56,125 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,1,1678575335623.b1b55df2e1201b31717429b4c155b168. 2023-03-11 22:55:56,125 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for b1b55df2e1201b31717429b4c155b168: 2023-03-11 22:55:56,125 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,1,1678575335623.b1b55df2e1201b31717429b4c155b168. 2023-03-11 22:55:56,125 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 078337168df669f0c39d86df4d8f6540, disabling compactions & flushes 2023-03-11 22:55:56,125 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,,1678575223634.078337168df669f0c39d86df4d8f6540. 2023-03-11 22:55:56,125 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,,1678575223634.078337168df669f0c39d86df4d8f6540. 2023-03-11 22:55:56,125 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,,1678575223634.078337168df669f0c39d86df4d8f6540. after waiting 0 ms 2023-03-11 22:55:56,126 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,,1678575223634.078337168df669f0c39d86df4d8f6540. 2023-03-11 22:55:56,128 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/default/testScannerOnBulkLoadRefHFiles/078337168df669f0c39d86df4d8f6540/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-03-11 22:55:56,128 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,,1678575223634.078337168df669f0c39d86df4d8f6540. 2023-03-11 22:55:56,128 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 078337168df669f0c39d86df4d8f6540: 2023-03-11 22:55:56,129 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,,1678575223634.078337168df669f0c39d86df4d8f6540. 2023-03-11 22:55:56,216 DEBUG [RS:0;jenkins-hbase20:41843] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-03-11 22:55:56,374 DEBUG [regionserver/jenkins-hbase20:0.Chore.1] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.0, tune throughput to 50.00 MB/second 2023-03-11 22:55:56,417 DEBUG [RS:0;jenkins-hbase20:41843] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-03-11 22:55:56,454 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.18 KB at sequenceid=130 (bloomFilter=false), to=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/hbase/meta/1588230740/.tmp/table/fdb864e8781a47019bb52622556d9208 2023-03-11 22:55:56,461 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fdb864e8781a47019bb52622556d9208 2023-03-11 22:55:56,462 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/hbase/meta/1588230740/.tmp/info/118094362c22456fb0ec12b5794f8a57 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/hbase/meta/1588230740/info/118094362c22456fb0ec12b5794f8a57 2023-03-11 22:55:56,468 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 118094362c22456fb0ec12b5794f8a57 2023-03-11 22:55:56,468 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/hbase/meta/1588230740/info/118094362c22456fb0ec12b5794f8a57, entries=226, sequenceid=130, filesize=37.9 K 2023-03-11 22:55:56,469 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/hbase/meta/1588230740/.tmp/rep_barrier/418eb595ba124e818f1597a11d96cd0f as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/hbase/meta/1588230740/rep_barrier/418eb595ba124e818f1597a11d96cd0f 2023-03-11 22:55:56,473 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 418eb595ba124e818f1597a11d96cd0f 2023-03-11 22:55:56,473 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/hbase/meta/1588230740/rep_barrier/418eb595ba124e818f1597a11d96cd0f, entries=1, sequenceid=130, filesize=5.0 K 2023-03-11 22:55:56,473 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/hbase/meta/1588230740/.tmp/table/fdb864e8781a47019bb52622556d9208 as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/hbase/meta/1588230740/table/fdb864e8781a47019bb52622556d9208 2023-03-11 22:55:56,476 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fdb864e8781a47019bb52622556d9208 2023-03-11 22:55:56,476 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/hbase/meta/1588230740/table/fdb864e8781a47019bb52622556d9208, entries=27, sequenceid=130, filesize=6.6 K 2023-03-11 22:55:56,478 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~50.62 KB/51839, heapSize ~78.19 KB/80064, currentSize=0 B/0 for 1588230740 in 863ms, sequenceid=130, compaction requested=false 2023-03-11 22:55:56,481 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/data/hbase/meta/1588230740/recovered.edits/133.seqid, newMaxSeqId=133, maxSeqId=1 2023-03-11 22:55:56,482 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-03-11 22:55:56,482 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-03-11 22:55:56,482 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-03-11 22:55:56,482 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-03-11 22:55:56,570 INFO [regionserver/jenkins-hbase20:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-03-11 22:55:56,571 INFO [regionserver/jenkins-hbase20:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-03-11 22:55:56,617 INFO [RS:0;jenkins-hbase20:41843] regionserver.HRegionServer(1171): stopping server jenkins-hbase20.apache.org,41843,1678575183185; all regions closed. 2023-03-11 22:55:56,626 DEBUG [RS:0;jenkins-hbase20:41843] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/oldWALs 2023-03-11 22:55:56,626 INFO [RS:0;jenkins-hbase20:41843] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C41843%2C1678575183185.meta:.meta(num 1678575185676) 2023-03-11 22:55:56,629 DEBUG [RS:0;jenkins-hbase20:41843] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/oldWALs 2023-03-11 22:55:56,630 INFO [RS:0;jenkins-hbase20:41843] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C41843%2C1678575183185:(num 1678575184710) 2023-03-11 22:55:56,630 DEBUG [RS:0;jenkins-hbase20:41843] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-11 22:55:56,630 INFO [RS:0;jenkins-hbase20:41843] regionserver.LeaseManager(133): Closed leases 2023-03-11 22:55:56,630 INFO [RS:0;jenkins-hbase20:41843] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase20:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-03-11 22:55:56,630 INFO [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-03-11 22:55:56,631 INFO [RS:0;jenkins-hbase20:41843] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:41843 2023-03-11 22:55:56,639 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-03-11 22:55:56,639 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,41843,1678575183185 2023-03-11 22:55:56,640 ERROR [Listener at localhost.localdomain/41563-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7d934c1d rejected from java.util.concurrent.ThreadPoolExecutor@79acd777[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 532] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-03-11 22:55:56,640 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-03-11 22:55:56,640 ERROR [Listener at localhost.localdomain/41563-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6acc6130 rejected from java.util.concurrent.ThreadPoolExecutor@79acd777[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 532] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-03-11 22:55:56,640 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase20.apache.org,41843,1678575183185] 2023-03-11 22:55:56,641 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase20.apache.org,41843,1678575183185; numProcessing=1 2023-03-11 22:55:56,642 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase20.apache.org,41843,1678575183185 already deleted, retry=false 2023-03-11 22:55:56,642 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase20.apache.org,41843,1678575183185 expired; onlineServers=0 2023-03-11 22:55:56,642 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase20.apache.org,44347,1678575181988' ***** 2023-03-11 22:55:56,642 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-03-11 22:55:56,643 DEBUG [M:0;jenkins-hbase20:44347] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1ec33cb1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-03-11 22:55:56,643 INFO [M:0;jenkins-hbase20:44347] regionserver.HRegionServer(1145): stopping server jenkins-hbase20.apache.org,44347,1678575181988 2023-03-11 22:55:56,643 INFO [M:0;jenkins-hbase20:44347] regionserver.HRegionServer(1171): stopping server jenkins-hbase20.apache.org,44347,1678575181988; all regions closed. 2023-03-11 22:55:56,643 DEBUG [M:0;jenkins-hbase20:44347] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-11 22:55:56,643 DEBUG [M:0;jenkins-hbase20:44347] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-03-11 22:55:56,643 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-03-11 22:55:56,643 DEBUG [M:0;jenkins-hbase20:44347] cleaner.HFileCleaner(317): Stopping file delete threads 2023-03-11 22:55:56,643 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1678575184420] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1678575184420,5,FailOnTimeoutGroup] 2023-03-11 22:55:56,643 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1678575184420] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1678575184420,5,FailOnTimeoutGroup] 2023-03-11 22:55:56,643 INFO [M:0;jenkins-hbase20:44347] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-03-11 22:55:56,643 INFO [M:0;jenkins-hbase20:44347] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-03-11 22:55:56,643 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-03-11 22:55:56,643 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-03-11 22:55:56,643 INFO [M:0;jenkins-hbase20:44347] hbase.ChoreService(369): Chore service for: master/jenkins-hbase20:0 had [] on shutdown 2023-03-11 22:55:56,644 DEBUG [M:0;jenkins-hbase20:44347] master.HMaster(1512): Stopping service threads 2023-03-11 22:55:56,644 INFO [M:0;jenkins-hbase20:44347] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-03-11 22:55:56,644 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-03-11 22:55:56,644 ERROR [M:0;jenkins-hbase20:44347] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-20,5,PEWorkerGroup] Thread[HFileArchiver-21,5,PEWorkerGroup] Thread[HFileArchiver-22,5,PEWorkerGroup] 2023-03-11 22:55:56,645 INFO [M:0;jenkins-hbase20:44347] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-03-11 22:55:56,645 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-03-11 22:55:56,646 DEBUG [M:0;jenkins-hbase20:44347] zookeeper.ZKUtil(398): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-03-11 22:55:56,646 WARN [M:0;jenkins-hbase20:44347] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-03-11 22:55:56,646 INFO [M:0;jenkins-hbase20:44347] assignment.AssignmentManager(315): Stopping assignment manager 2023-03-11 22:55:56,646 INFO [M:0;jenkins-hbase20:44347] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-03-11 22:55:56,646 DEBUG [M:0;jenkins-hbase20:44347] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-03-11 22:55:56,646 INFO [M:0;jenkins-hbase20:44347] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-03-11 22:55:56,646 DEBUG [M:0;jenkins-hbase20:44347] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-03-11 22:55:56,646 DEBUG [M:0;jenkins-hbase20:44347] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-03-11 22:55:56,646 DEBUG [M:0;jenkins-hbase20:44347] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-03-11 22:55:56,646 INFO [M:0;jenkins-hbase20:44347] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=513.11 KB heapSize=598.95 KB 2023-03-11 22:55:56,740 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-03-11 22:55:56,741 INFO [RS:0;jenkins-hbase20:41843] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase20.apache.org,41843,1678575183185; zookeeper connection closed. 2023-03-11 22:55:56,741 ERROR [Listener at localhost.localdomain/41563-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@12d04263 rejected from java.util.concurrent.ThreadPoolExecutor@79acd777[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 532] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-03-11 22:55:56,741 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@19b3013a] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@19b3013a 2023-03-11 22:55:56,741 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): regionserver:41843-0x1000296b5630001, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-03-11 22:55:56,741 ERROR [Listener at localhost.localdomain/41563-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@554d9628 rejected from java.util.concurrent.ThreadPoolExecutor@79acd777[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 532] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-03-11 22:55:56,741 INFO [Listener at localhost.localdomain/41563] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 1 regionserver(s) complete 2023-03-11 22:55:57,061 INFO [M:0;jenkins-hbase20:44347] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=513.11 KB at sequenceid=1006 (bloomFilter=true), to=hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/f93351c2f58d4564adde540fa779c6fd 2023-03-11 22:55:57,065 INFO [M:0;jenkins-hbase20:44347] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f93351c2f58d4564adde540fa779c6fd 2023-03-11 22:55:57,066 DEBUG [M:0;jenkins-hbase20:44347] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/f93351c2f58d4564adde540fa779c6fd as hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/f93351c2f58d4564adde540fa779c6fd 2023-03-11 22:55:57,069 INFO [M:0;jenkins-hbase20:44347] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f93351c2f58d4564adde540fa779c6fd 2023-03-11 22:55:57,069 INFO [M:0;jenkins-hbase20:44347] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38541/user/jenkins/test-data/e505cb74-5b7c-9769-4dbb-9b7ee3e3a7c9/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/f93351c2f58d4564adde540fa779c6fd, entries=123, sequenceid=1006, filesize=33.3 K 2023-03-11 22:55:57,069 INFO [M:0;jenkins-hbase20:44347] regionserver.HRegion(2948): Finished flush of dataSize ~513.11 KB/525421, heapSize ~598.93 KB/613304, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 423ms, sequenceid=1006, compaction requested=false 2023-03-11 22:55:57,070 INFO [M:0;jenkins-hbase20:44347] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-03-11 22:55:57,070 DEBUG [M:0;jenkins-hbase20:44347] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-03-11 22:55:57,072 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-03-11 22:55:57,072 INFO [M:0;jenkins-hbase20:44347] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-03-11 22:55:57,073 INFO [M:0;jenkins-hbase20:44347] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:44347 2023-03-11 22:55:57,074 DEBUG [M:0;jenkins-hbase20:44347] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase20.apache.org,44347,1678575181988 already deleted, retry=false 2023-03-11 22:55:57,175 INFO [M:0;jenkins-hbase20:44347] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase20.apache.org,44347,1678575181988; zookeeper connection closed. 2023-03-11 22:55:57,175 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-03-11 22:55:57,175 ERROR [Listener at localhost.localdomain/41563-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7091e6b9 rejected from java.util.concurrent.ThreadPoolExecutor@32aff0d8[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 906] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-03-11 22:55:57,175 DEBUG [Listener at localhost.localdomain/41563-EventThread] zookeeper.ZKWatcher(600): master:44347-0x1000296b5630000, quorum=127.0.0.1:51815, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-03-11 22:55:57,175 ERROR [Listener at localhost.localdomain/41563-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1b14e0f0 rejected from java.util.concurrent.ThreadPoolExecutor@32aff0d8[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 906] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-03-11 22:55:57,177 WARN [Listener at localhost.localdomain/41563] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-03-11 22:55:57,184 INFO [Listener at localhost.localdomain/41563] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-03-11 22:55:57,291 WARN [BP-663182591-148.251.75.209-1678575178162 heartbeating to localhost.localdomain/127.0.0.1:38541] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-03-11 22:55:57,292 WARN [BP-663182591-148.251.75.209-1678575178162 heartbeating to localhost.localdomain/127.0.0.1:38541] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-663182591-148.251.75.209-1678575178162 (Datanode Uuid d759cbe2-d04a-43b0-bc2a-2313ebea261f) service to localhost.localdomain/127.0.0.1:38541 2023-03-11 22:55:57,294 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/87368fcc-6f9d-8d4a-6393-acc3a85b6a4f/cluster_01183c7b-d60b-1c38-923f-d300051bd96f/dfs/data/data1/current/BP-663182591-148.251.75.209-1678575178162] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-03-11 22:55:57,294 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/87368fcc-6f9d-8d4a-6393-acc3a85b6a4f/cluster_01183c7b-d60b-1c38-923f-d300051bd96f/dfs/data/data2/current/BP-663182591-148.251.75.209-1678575178162] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-03-11 22:55:57,325 INFO [Listener at localhost.localdomain/41563] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:0 2023-03-11 22:55:57,457 INFO [Listener at localhost.localdomain/41563] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-03-11 22:55:57,544 INFO [Listener at localhost.localdomain/41563] hbase.HBaseTestingUtility(1293): Minicluster is down